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@ Image data coding and restoring method and appatatus for coding and restoring the same. 

(57) When encoding the continuous image by divi- 
ding the respective frames into a plurality of 
blocks, the image in the block in the present 
frame is compared with a corresponding image 
in the block in the same position of the refer- 
ence frame and the amount of the changes of 
the predetermined image element within res- 
pective blocks is calculated. Only when the 
amount of change exceeds the predetermined 
threshold value, the image data of respective 
blocks is coded. A plurality of threshold values 
can be adapted and appropriately changed by 
considering a spatially changing pattern of the 
amount of the change of the image from the 
reference frame or a refreshing operation. 
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Background of the Invention 
Field of the Invention 

The present invention relates to an image data s 
coding method of coding the image data with a high 
efficiency, an apparatus for coding an image data, a 
restoring method of decoding the coded image and 
an apparatus for restoring the same and more partic- 
ularly to an image data coding and decoding method 10 
of dividing the image data into a plurality of blocks to 
produce the coded data of all the images related to 
the respective blocks obtained by dividing the image 
data. 

Description of the Related Art 

In the field of a television conference/television 
telephone involving colored static images and colored 
moving image, the image data whose information ca- 20 
pacity is much greater than typical numerical data are 
used, and more particularly, the data of the inter- 
mediate level of the image, or the colored image data 
requires high-speed and high quantity transmission. 
Therefore, it is necessary to process the coding of the 25 
values of the respective image elements with a high 
efficiency. 

The adaptive discrete cosine transform method is 
known as an example of an image data coding meth- 
od with a high efficiency. 30 

This adaptive discrete cosine transform method 
(which is abbreviated as ADCT) divides the image into 
a plurality of blocks comprising, for example, 8 x 8 im- 
age elements, transforms the image signal of respec- 
tive blocks into (two-dimensional DCT coefficients 35 
corresponding to the distributions of the space fre- 
quency by the two-dimensional discrete cosine trans- 
form), quantizes the two-dimensional DCT coeffi- 
cient within a block obtained by the transform by us- 
ing a t hreshoid value suitable for vision, and then en- 40 
codes the quantized coefficient by using a huffman 
table obtained statistically. 

The conventional coding device for the static im- 
age using the ADCT encodes the respective images 
separately, even if the respective values between inv 45 
ages do not change greatly because of a dose inter- 
relation between them, for example, in the case of a 
moving image which is considered as a group of static 
images. 

Figure 1 shows an example of a structure of the so 
conventional coding apparatus for a static image. 

A static image is divided into a plurality of blocks 
comprising 8x8 image elements, for example, and is 
inputted from the input terminal 110 and the respec- 
tive image signals are sequentially restored in the in- 55 
put order to t he block buffer 120. 

The two-dimensional DCT unit 130 reads the re- 
spective image signals from block buffer 120 by trans- 



forming the image signal corresponding to a plurality 
of image elements in respective blocks into the two- 
dimensional DCT coefficient corresponding to the 
space frequency of the same number as the plurality 
of image elements by using the two-dimensional dis- 
crete cosine transform. 

Linear quantization unit 140 quantizes the two-di- 
mensional DCT coefficient (matrix) of respective 
blocks by using the quantizing threshold value (quan- 
tizing matrix) which is suitable for vision and obtained 
from visual experimentation. 

Variable length coding unit 160 performs a vari- 
able length coding of the quantization coefficient ob- 
tained by quantizing unit 140 by using the huffman 
coding table 1 70 obtained statistically, and outputs 
from the output terminal 180 the coded data obtained 
from the variable length coding method. 

In the variable length coding method, the quan- 
tizing coefficient (matrix) arranged in a two-dimen- 
sional manner is converted to a one-dimensional train 
of numerical values by using a scanning operation 
called zig-zag scanning and performs a variable 
length coding based on the difference between the 
head DCT coefficient of a block and the head DCT 
coefficient of the preceding block with regard to the 
DC component. The value of the valid coefficients 
whose value is not zero is combined with the length 
of run (Run-length of the invalid coefficient whose 
value is zero), thereby applying the variable length 
coding to respective blocks. 

Figure 2 shows a structure of a conventional re- 
storing apparatus of t he static image for restoring data 
coded by the above-recited variable length coding to 
the images. 

The data coded by the coding apparatus for the 
static image is inputted from the input terminal 210 to 
variable length restoring unit 220 in units of blocks. 

The variable length restoring unit 220 restores 
the quantizing coefficient of the DC component and 
AC components in the respective Mocks using the 
huffman coding table 170 (huffman decoding table 
270) which is used in the above variable length cod- 
ing. 

Dequantization unit 230 converts the decoded 
quantization coefficient of respective DC component 
and AC component into the two-dimensional DCT 
coefficients by using the quantized value 250 (quan- 
tized matrix). 

Inverse DCT transforming unit 240 performs the 
two-dimensional DCT transform by using the two-di- 
mensional DC coefficient of the respective blocks 
which are decoded and restored as the image ele- 
ments. 

The image signal of respective restored image 
elements is stored within the image memory 250 in 
units of blocks. 

An operation of the image signal of respective im- 
age elements at image blocks into the image memory 
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250 Is controlled by inside-block Image element writ- 
ing controlling unit 260 and controls the block address 
generating unit 270 and enables It to output an ad- 
dress of a block in which the image signal is to be writ- 
ten into the image memory 250 and performs a writ- 
ing operation of the image signal of respective image 
elements of the present frame into the image memory 
250 in units of blocks. 

There is a method of coding a moving image 
which is subject to a continuous scene, i.e. a televi- 
sion conference or a television telephone system. 
Conventionally, the respective images are subject to 
the methods of coding the moving images. 

Figure 3 shows a block diagram of a basic part of 
the moving image coding apparatus by using an inter- 
frame prediction coding method of utilizing a relation 
between the image in reference frame and the image 
in the present frame. 

The image of respective scenes of the moving im- 
age Is inputted to difference image generating unit 
320 through input terminal unit 310; 

The reference image which is obtained by restor- 
ing the image in the preceding frame and is used as 
the image in the reference frame. 

The difference generating unit 320 obtains the 
difference image between the reference images stor- 
ed in an image memory 330 and the present image 
(the image in the present frame) inputted from the in- 
put terminal 310 and stores the difference image in 
block buffer 340. The difference image can be ob- 
tained for respective blocks comprising image ele- 
ments of 8 x 8, for example. Therefore, the block buf- 
fer 340 stores the difference image i.e difference 
block image between the block in the reference frame 
of 8 x 8 image element, for example and the corre- 
sponding block in the present frame of 8 x 8 image 
elements with regard to the blocks in the same posi- 
tion. 

The two-dimensional DCT transform 350 applies 
the two-dimensional DCT transform to the difference 
block image of 8 x 8 image elements stored in the 
block buffer 340 obtains the 8 x 8 DCT coefficients, 
and thereby outputs them to quantization unit 360. 

Quantization unit 360 applies a linear quantiza- 
tion to 8 x 8 coefficients by using adequate threshold 
value applicable to an eyesight, thereby providing 8 
x 8 quantized coefficients. 

The 8x8 quantization coefficients are subject to 
zig-zag scanning and is outputted to variable length 
coding unit 370 in the order of the DC component AC 
components with a low space frequency AC compo- 
nents with relatively high space frequency. 

The variable coding unit 370 performs a variable 
length coding of the 8x8 input quantized coefficients 
by using huffman coding table 380 and outputs the 
data coded by the variable lengt h coding from the out- 
put terminal 390. 

The 8x8 quantizes coefficient matrix outputted 



from quantization unit 360 is inputted to the dequan- 
tization unit 390 and the dequantization unit 390 re- 
stores it into the two-dimensional DCT coefficient 
matrix. 

s Inverse two-dimensional DCT transform unit 400 

performs the inverse two-dimensional DCT trans- 
form by using 8x8 two-dimensional coefficient and 
restores the above difference block image. 

The adding unit 410 adds the restored difference 

io block image to the preceding image of the block in the 
same position in the reference image as in the posi- 
tion in the present block image and again rewrites the 
image obtained by the addition into the image mem- 
ory 330. 

15 The above-recited sequential operation is applied 
to all the blocks of the image (the present image) of 
the new frame inputted from the input terminal 410. 
thereby enabling the coded data of the difference im- 
age regarding all the blocks of the present image to 

20 be outputted from the output terminal 390. As dis- 
cussed above, the Image data of the present frame is 
not coded as it is and a difference image between the 
reference frame and the present frame is coded, 
thereby decreasing the amount of the coding. The 

25 same image as restored from the image of the pres- 
ent frame, which is restored based on the coded data 
of the difference image on the image restoring side, 
is stored in the image memory 330 as the reference 
image to be used as the image of the reference frame 

30 when the image of the succeeding frame is inputted 
from the input terminal 310. 

Figure 4 shows a principle structure of a conven- 
tional restoring apparatus of the moving image for re- 
storing the image of the coded data outputted from 

35 the conventional coding device for the moving image. 
A variable length restoring unit 520 inputs the 
coded data obtained by applying a variable length 
coding to the difference image in units of block from 
the input terminal 510 and restores the coded data 

40 into guantization coefficients in units of blocks by us- 
ing Huffman coding table 580, which is the same as 
the Huffman coding table 380 in the conventional 
coding apparatus for the moving image. 

Dequantization unit 530 performs a dequantiza- 

45 tion of quantization coefficients of respective blocks 
by using the same matrix as used in the dequantiza- 
tion units 390 In the coding apparatus for the moving 
image, and restores the two-dimensional DCT coef- 
ficients of respective blocks. 

50 Inverse two-dimensional DCT transforming unit 
540 restores the difference image of respective 
blocks by performing the inverse two-dimensional 
DCT conversion in units of blocks by using the two- 
dimensional DCT coefficient matrixes of respective 

55 blocks. 

Adding unit 550 adds the decoded difference im- 
age of respective blocks to the image In the block in 
the same position in image memory 560 and the inv 
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age obtained by this adding operation is rewritten in 
image memory 560. 

A writing operation of a restored image into image 
memory 560 for respective blocks is controlled by in- 
tra-block image element write controlling unit 570. In- 5 
tra-block image element write controlling unit 570 
controls block address generating unit 590 and out- 
puts an address of the particular block which is stored 
in the image memory and to which the difference im- 
age is added, to image memory 560 from block ad- 10 
dress generating unit 590, thereby writing the restor- 
ation image of respective frames in the image mem- 
ory 560 in units of blocks. 

The above sequential process is applied to the 
coded data of t he difference image of all blocks of re- 15 
spectrve frames of the image and thus image memory 
560 stores the restoration image of respective 
frames. 

However, the above recited conventional tech- 
nology has the following problems. 20 

In the conventional coding technology of the sta- 
tic image, even respective images having small vari- 
ation between continuous images are independently 
coded. Thus, even If the variation between the con- 
tinuous images is very smaO such as images for a 25 
moving or a television telephone having a camera 
fixed, the compression ratio cannot be increased. 

When the coding technology for the moving Im- 
age as shown in Figure 3 is used, the compression ra- 
tio can be raised owing to the difference coding met h- do 
od but it requires a larger scale of apparatuses. In the 
conventional coding apparatus for the moving image, 
the difference image between the present frame and 
the reference frame is calculated and the image of the 
reference frame to be used for obtaining the differ- 35 
ence image is stored in the image memory 330. The 
variable length coding to the above ADCT is irrever- 
sible coding (information loss coding) and thus the 
error of the difference image from the original image 
becomes large when the number of accumulations 40 
exceeds a predetermined number and thus the qual- 
ity of the image stored in the image memory 320 is 
decreased evidently. Therefore, it is necessary to re- 
fresh the image in an inter-frame mode at a predeter- 
mined number of frame intervals. 45 

The inter-frame mode performs a variable length 
coding of the input image according to the ADCT in 
the similar manner to the conventional coding appa- 
ratus for the static image. 

When the inverse two-dimensional DCT trans- so 
form unit 400 used in the conventional decoding ap- 
paratus of the moving image is different from the two- 
dimensional DCT transform unit 540 used in the con- 
ventional coding apparatus for the moving image in 
respect of an operation or operation method, the er- 55 
rors generated in coding operations are stored and 
accumulated in the image memories 330 and 560, the 
noise caused by the accumulated errors becomes 



evident. Therefore, CCITT recommendation H-261 
recommends that a refreshing operation should be 
performed at least once by using the above inter-fra- 
me mode during the period of 132 coding operations 
to solve the above problem of the accumulated errors 
generated due to a mis-match between the inverse 
two-dimensional DCT transform unit 400 and 540 in 
both apparatuses. 

In the inter-frame mode, the image data of all 
blocks of one frame is coded as it is and the coded 
data of all blocks of one frame are transmitted to the 
receiving side. The frame in which such a coding is 
performed is called a refresh frame and such a coding 
is called refreshing. A quantity of the coding of the re- 
fresh frame in which the image data of all the blocks 
of one frame are coded as is, is greatly different from 
the quantity of coding of the ordinary frame in which 
only the difference image is coded. Namely, a quan- 
tity of the coding of the refresh frame is usually larger 
than that of the ordinary frames. 

Therefore, when the image is transmitted by per- 
forming the data compression using such a high effi- 
ciency coding method as described above in televi- 
sion conference or a television telephone, the receiv- 
er of the coded data restores the frame after a longer 
time period passes upon receipt of the coded data of 
the refreshing frame than upon receipt of the coded 
data of an ordinary frame. 

This difference in receiving time causes a receiv- 
er of the image to feel it naturally long. 

When the image is transmitted at ten frames per 
second through an ISDN (Integrated Service Digital 
Network) with the transmission rate of 64Kbps pro- 
vided by a Japanese Telecommunication and Tele- 
phone Company, the amount of coded data of one 
frame should be less than 6400 bits. 

Generally speaking, a quantity of coded data of 
one frame in the case of the ordinary frame can be 
compressed less than 6400 bits but the quantity of 
the coded data of one frame in the case of the re- 
freshed frame is sometimes more than 6400 bits. 

When a quantity of coded data per one frame ex- 
ceeds the maximum quantity of coded data (which is 
6400 bits in this case) of one frame which is originally 
assigned to one frame, the transmission processing 
of the refresh frame cannot be completed within the 
processing time assigned to the refresh frame and is 
extended into the processing time of the next frame. 

In this case, the coding process of the next frame 
is not performed and the transmission process of the 
refresh frame wll be performed. As a result, the frame 
which is not subject to the coding process is not trans- 
mitted to the receiving side and the monftor screen on 
the receiving side is displayed with one frame miss- 
ing. 

This example is shown in Figure 5. 
In Figure 5, the third frame is a refresh frame and 
quantity of the coded data of the refresh frame ex- 
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ceeds 6400 bits. Therefore, the image of the third 
frame is not restored at time T3 when the image of the 
third frame should be restored on the monitor screen 
in the receiving side. An image of the third frame is 
restored at time T4, at which the image of the fourth 
frame should be restored. Thus, the image of the 
frames following the fourth frame are restored with 
one frame delay. 

In the case of transferring the moving image, the 
coding side and decoding side have the coding buf- 
fers. 

These code buffers are respectively provided in 
a succeeding stage of the variable length coding unit 
370 and in a preceding stage of the variable length 
decoding unit 520 as shown in Figures 3 and 4. These 
code buffers have to store the data when the refresh- 
ing operation is performed, and thus the capacity of 
these code buffers depend on the maximum amount 
of the data of one frame, namely, the amount of data 
required for the refreshing operation. Accordingly, the 
decrease of the capacity of these code buffers great- 
ly contribute to realization of a small size and inexpen- 
sive coding and decoding apparatus. 

When the refreshing operation is performed, the 
image data of all the blocks of the refresh frame are 
coded without being subject to any process, as recit- 
ed above and thus the amount of the coded data in 
the refreshing frame is greater than that in the ordi- 
nary frame which updates only the difference image. 
Therefore, there is a problem that a time spent to up- 
date the reference frame upon performing the re- 
freshing operation becomes longer than that to up- 
date the reference frame upon coding the ordinary 
frame. 

The variation between two consecutive frames in 
the moving image depends on the kind of the image. 
Therefore, upon performing the refreshing operation, 
the amount of the data is increased in the case of the 
image with a large movement and thus the refreshing 
operation sometimes cannot satisfy various condi- 
tions of the transmission line such as an information 
transmitting rate and the number of frames transmit- 
ted per unit time. 

There is also a problem that the image appears 
strange as if it flashes at t he time of the refreshing op- 
eration since a large amount of errors compared to 
the original image is accumulated in the image data 
of the reference frame before t he refreshing operation 
is applied to the reference frame. 

Summary of the Invention 

An object of the present invention is to provide an 
image data proceeding method and apparatus for 
coding and decoding consecutive images in which va- 
riation between two consecutive images is small by 
using a small scale circuit with a high efficiency ap- 
paratus performing the same. 



Another object of the present invention is to dis- 
play the refresh frame having a large amount of coded 
data by using a code buffer of a small size so that the 
receiver does not feel or recognize a waiting time 

5 even in the case of the refresh frame. 

A further object of the present invention is to up- 
date the reference frame at a high speed when the re- 
fresh operation is performed. 

A further more object of the present invention is 

10 to transmit the image in an optimum manner in accor- 
dance with various conditions such as an information 
transmission rate of the transmission line and the 
number of frames to be transmitted per unit time with 
regard to respective frames. 

15 A stfli further object of the present invention is to 
enable the refreshment operation so that it can be 
performed without causing the refreshing frame to 
appear strange. 

The present inventidn provides an image data 

20 coding method for coding image data in units of 
blocks by dividing a frame into a plurality of blocks 
comprising a step for comparing the image data in the 
block in the present frame corresponding to the im- 
age data in the block in the same position of the ref- 

25 erence frame and determining the existence of 
change in the image in the block of the present frame 
compared to the corresponding image in the block in 
the same position of the reference frame, and a step 
for outputting the block information designating a val- 

30 id block in which the image changes from the refer- 
ence frame or an invalid block in which the image 
does not change from the reference frame, and a step 
for decoding only the image data of a valid block. 
Therefore, the present invention encodes only 

35 the image data of the valid block whereby the image 
changes from the reference frame and thus the 
amount of coded data in the continuous image, such 
as the moving image including many background por- 
tions which does not change in the image can be de- 

40 creased. 

The present invention is a method for decoding 
the image data from the coded data of the image data 
generated by the above image data encoding method 
and the block information wherein said method conv 

45 prises a step for decoding the image data of the valid 
block from the coded data, a step for updating the ad- 
dress of the image memory in which the image data 
of the valid block is to be written, based on the content 
of the block information and a step for writing the de- 

50 coded image data of the valid block in the image 
memory in accordance with the updated address. 

The present invention decodes only the image 
data of the valid block and writes the decoded image 
data to a corresponding area of the image memory, 

55 thereby enabling image data to be decoded efficient- 
ly. 

The present invention provides a method for en- 
coding the continuous image data by encoding a re- 
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fresh frame, by dividing it into a plurality of portions. 

The present invention provides a method for en- 
coding the image data by a first step of comparing the 
image data in the block in the present frame with cor- 
responding image data in the block in the same pos- 
ition in the reference frame and determining the ex- 
istence of change in the image in the block of the 
present frame compared to the corresponding image 
in the block in the same position in the reference 
frame, a second step for encoding the valid block of 
the present frame which is determined as having the 
change in the image from the reference frame in the 
first step when the present frame is not a refresh 
frame, and the third step of encoding the valid block 
of the reference frame and encoding the invalid block 
of the present frame in which the image is determined 
as not having the change from the reference frame in 
the first step after the completion of the encoding of 
the valid block when the present frame is a refresh 
frame. 

When the refresh frame is encoded, only the valid 
block which has great affect on the decoded image is 
first encoded and then all the invalid blocks are en- 
coded after the completion of all the valid blocks. 
Therefore, it can decode the refresh frame in a more 
natural manner than in the conventional art even if 
the amount of the codes in the refresh frame is plen- 
tiful , thereby decreasing the capacity of both on the 
coding side and decoding side. 

The present invention provides a method of de- 
coding an image data to decode the continuous im- 
age data comprising a first step of determining the ex- 
istence of change in the image in the block in the 
present frame compared to the corresponding image 
in the block in the reference frame, a second step of 
encoding only the valid block of the present frame 
which is determined as having the change in the im- 
age from the reference frame in accordance with the 
first step when the frame is not a refresh frame, a third 
step of encoding a valid block of the present frame 
and then encoding the invalid block of the present 
frame which is determined as not having the change 
in the image from the reference frame in accordance 
with a first step at t he completion of the decoding and 
encoding operations, when the present frame is the 
refresh frame, a fourth step of updating the image 
data in the block in the reference frame compared to 
the corresponding image data in the valid block in the 
present frame to the valid block of the coded present 
frame after the completion of the second step and a 
fifth step of switching the image data of the present 
frame to the image data of the reference frame after 
the completion of the third step. 

Therefore, the present invention switches the im- 
age frame of the present frame to the image data in 
the reference frame in accordance with the fifth step 
when the coding of the refresh frame is completed in 
the third step and thus can update the reference 



frame upon a refreshing operation at a high speed. 

The present invention provides an image data 
coding method of coding consecutive image data 
comprising a first step of obtaining the amount of 

5 change of the value of the predetermined image ele- 
ment in the block in the present frame compared to 
the corresponding image element in the block in the 
same position of the reference frame, comparing the 
amount of the change wit h the predetermined thresh- 
to old value and determining the existence of the 
change of the image between the block in the present 
frame compared to the corresponding image in the 
block in the same position with the reference frame, 
a second step of coding only the valid block of the 

15 present frame which is determined as having the 
change in the image from the reference frame in ac- 
cordance with the first step, a third step of determin- 
ing whether the threshold value obtained with the 
first step, a third step of determining whether the 

20 threshold value obtained in the first step is appropri- 
ate, based on the quantity of the coded data obtained 
by the second step and changing the threshold value 
to another value when the threshold value is not ap- 
propriate one, thereby repeating the first and second 

25 steps until it is determined in the third step that the 
threshold value is appropriate. 

The present invention provides a method of en- 
coding the image data comprising a first step of ob- 
taining the amount of change of the value of the pre- 

30 determined image element in the block in the present 
frame compared to the corresponding image in the 
block at the same position of the reference frame, 
comparing the amount of the change with the prede- 
termined threshold value and determining the exis- 

35 tence of the change of the image in the block in the 
present frame compared to the corresponding image 
in the block in the same position of the reference 
frame, a second step of determining whether the 
threshold value used in the first step is appropriate, 

40 based on the above valid block of the present frame 
which is determined as having the change in the 
frame from t he reference frame in the first step or t hat 
of the invalid block in the reference frame which is de- 
termined as having the change in the reference frame 

45 in the first step or that of the invalid block in the pres- 
ent frame which is determined as not having the 
change in the image from the reference frame, and 
changing the threshold value to another value when 
the threshold value is not appropriate, a third step for 

50 decoding the block of the present frame which is de- 
termined as the valid block in the first step and whose 
threshold value is determined as being appropriate in 
the second step, thereby performing the first step 
when the threshold value is again determined in the 

55 second step. 

The present invention repeats the process of 
changing the threshold value to be used to determine 
whet her the amount of the image data of the present 
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frame, the number of valid blocks of the present frame 
or the number of the invalid blocks, based on the 
quantity of the whole image data of the present frame 
which is determined as the valid block or invalid block 
until the quantity of the code, the number of valid 
blocks or that of the invalid blocks are determined as 
appropriate and outputs the coded data when they 
are determined to be appropriate by the determining 
step, thereby being capable of coding the appropriate 
quantity of the coding can be achieved in accordance 
with a quantity of the image corresponding to the im- 
age data and a transmission line capacity: 

The present invention provides a method of en- 
coding the image data comprises a first step of ob- 
taining the amount of the change of the determination 
image element forming the reference by which the ex- 
istence of the change of the image in the block in the 
present frame compared to the corresponding image 
in the block in the same position in the reference 
frame is determined and preparing frames of the 
present frame with regard to the amount of the im- 
ages, a second step of determining the threshold val- 
ue to be used to determine the existence of change 
of the image in the block in the present frame com- 
pared to the block in the same position of the refer- 
ence frame, based on the histogram obtained through 
the first step, a third step for obtaining the amount of 
the change of the value of the image data predeter- 
mined in the block in the present frame compared to 
the corresponding image in the block in the same 
position of the reference frame, comparing the 
amount of the change with the determining threshold 
value provided in the second step and detecting the 
existence of change of the image in the block in the 
present frame compared to the image in the reference 
frame, and fourth step of encoding only the image 
data of the valid block which is determined as change 
in the image from the reference frame in accordance 
with the third step with regard to all the blocks of the 
present frame. 

Therefore, the present invention can transmit an 
optimum image in accordance with the condition of 
the number of the transmitted frames are units. 

The present invention provides the coding image 
data in units of blocks by dividing frame into a plurality 
of blocks comprising a step of obtaining the change 
of the value of the predetermined image element in 
the block in the present frame compared to the image 
in the same position of the reference frame, compar- 
ing the amount of the change of the respective blocks 
of the present frame determining the threshold value 
and determining whether block of the present frame 
is valid block in which the image changes from the ref- 
erence frame, a step of changing the determination in 
accordance with the result of determination, and step 
of coding the image data of the blocks which are de- 
termined as the valid blocks in the above determina- 
tion process. 



The present invention changes the magnitude of 
the threshold value for detecting the change of the 
image depending on whether the block of the present 
frame changes from that of the reference frame. 
5 Therefore it can determine a starting and ending in 
the block image change in the consecutive region of 
the image change appropriately even if the amount of 
the change of the image is not uniform in respective 
blocks in the region in which the image changes con- 
to tinuousiy with regard to the reference frame. It can 
decode the image of the consecutive region in which 
the amount of the change of the image is not formed 
in a natural manner. 

15 Brief Description of the Drawings 

One skilled in the art can easily understand ad- 
ditional features and objects of this invention from the 
description of the preferred embodiments and some 
20 of the attached drawings. In the drawings: 

Figure 1 shows a block diagram of a structure of 

the conventional coding apparatus of the static 

image; 

Figure 2 shows a block diagram of a structure of 
25 conventional decoding apparatus of the static im- 
age; 

Figure 3 shows a block diagram of a structure of 
a basic concept of the conventional coding appa- 
ratus for the moving image; 

30 Figure 4 shows a block diagram of a structure of 
the principle portion of the conventional decod- 
ing apparatus for the moving image; 
Figure 5 shows a view for explaining the problem 
of the conventional data coding method; 

35 Figure 6 shows a view for explaining the first im- 
age data coding method according to an embodi- 
ment of the present invention; 
Figure 7 shows a flow chart for explaining the first 
image data decoding method according to an em- 

40 bodiment of the present invention; 

Figure 8 shows a block diagram of a circuit of the 
first image data coding apparatus according to an 
embodiment of the present invention; 
Figures 9A to 9C show an embodiment of the 

45 block variation determining unit; 

Figure 10 shows a format of coded data output 
from the first image data coding apparatus; 
Figure 11 shows a circuit structure of the first im- 
age data restoring unit for restoring the coded 

60 data produced by the first image data coding ap- 
paratus into the image data; 
Figure 12 shows a circuit block diagram of an in- 
ternal arrangement of the above-described ad- 
dress calculating unit; 

55 Figure 13 shows a schematic circuit block dia- 
gram for showing an overall arrangement of a 
second image data coding apparatus according 
to another currently preferred embodiment of the 
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present invention; 

Figure 14 shows a format of multiplexer first out- 
puts the coded data produced by the second im- 
age data coding apparatus; 
Figure 15 shows a schematic circuit block dia- 5 
gram for showing an overall arrangement of a 
second image data decoding apparatus accord- 
ing to the present invention; 
Figure 16 shows a schematic circuit block dia- 
gram for showing an entire arrangement of a third 10 
image data coding apparatus according to the 
present invention; 

Figure 17 shows a circuit block diagram of an 
overall arrangement of a third image data decod- 
ing apparatus according to another currently pre- 1 5 
f erred embodiment of the present invention; 
Figure 18 is a flowchart indicating the 2nd image 
data encoding method according to an embodi- 
ment of the present invention; 
Figure 19 is a block diagram showing the circuit 20 
configuration of the 4th image data encoding de- 
vice according to an embodiment of the present 
invention; 

Figure 20 is a block diagram showing an example 
of the circuit configuration of the encoding unit in 25 
the 4th image data encoding device; 
Figures 21 A to 21 E show an explanatory view of 
a practical operation of the 4th through 7th image 
data encoding devices according to an embodi- 
ment of the present invention; 30 
Figures 22A to 22D show an explanatory view of 
an operation of the 4th through 7th image data 
encoding devices according to an embodiment of 
the present invention; 

Figures 23A to 23F show an explanatory view of 35 
another operation of the 4th through 7th image 
data encoding devices according to an embodi- 
ment of the present invention; 
Figure 24 shows a flowchart indicating the 3rd 
image data encoding method according to an em- 40 
bodiment of the present invention; 
Figure 25 is a block diagram showing the circuit 
configuration of the 5th image data encoding de- 
vice according to the embodiment of the present 
invention; 45 
Figure 26 is a flowchart indicating the 4th image 
data encoding method according to an embodi- 
ment of the present invention; 
Figure 27 is a block diagram showing the circuit 
configuration of the 6th Image data encoding de- 50 
vice according to the embodiment of the present 
invention; 

Figure 28 is a flowchart indicating the 5th image 
data encoding method according to an embodi- 
ment of the present invention; 55 
Figure 29 is a block diagram showing the circuit 
configuration of the 7th image data encoding de- 
vice according to the embodiment of the present 



invention; 

Figure 30 shows a block diagram indicating the 
configurations of the 8th and 9th image data en- 
coding devices according to the present inven- 
tion; 

Figure 31 shows a block diagram showing the 
configuration of the 10th image data encoding 
device; 

Figure 32 shows a block diagram showing the 
configuration of the 11th image data encoding 
device; 

Figure 33 shows a block diagram showing the 
configuration of the 12th image data encoding 
device; 

Figure 34 shows a block diagram showing the 
configuration of the 13th image data encoding 
device; 

Figure 35 shows a block diagram showing the 
configuration of the 14th image data encoding 
device; 

Figure 36 shows a block diagram indicating an 
aspect of the determination threshold output unit 
in the 14th image data encoding device; 
Figure 37 shows a block diagram indicating an- 
other aspect of the above described determina- 
tion threshold output unit in the 14th image data 
encoding device; 

Figure 38 shows a flowchart indicating the 6th 
image data encoding method as an embodiment 
of the present invention; 
Figure 39 shows an explanatory view of decoding 
reference frame when the 6th image data encod- 
ing method is used; 

Figure 40 shows a block diagram indicating the 
circuit configuration of the 15th image data en- 
coding device for encoding image data according 
to the 6th image data encoding method; 
Figure 41 shows a block diagram indicating the 
circuit configuration of the 16th image data en- 
coding device for encoding image data according 
to the encoding method indicated in the flow- 
chart; 

Figure 42 shows an example of a configuration of 
the encoding unit in the 1 5th and 16th image data 
encoding device: 

Figure 43 shows a flowchart indicating the 7th 
image data encoding method; 
Figure 44 shows a circuit configuration of the 
17th image data encoding device for encoding 
image data according to the encoding method in- 
dicated in the flowchart; 
Figure 45 shows a flowchart indicating the impor- 
tant operation of the 8th image data encoding 
method according to the embodiment 
Figure 46 shows a block diagram showing the 
main part of the circuit of the 18th image data en- 
coding device; 

Figure 47 shows a configuration of the 19th mv 
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age data encoding device for encoding image 
data in each frame according to the above descri- 
bed method II; 

Figure 48 shows a configuration of the 20th im- 
age data encoding device for encoding image 5 
data in each frame according to the above descri- 
bed method III; 

Figure 49 shows a configuration of the 21st im- 
age data encoding device for encoding image 
data in each frame according to the above descri- 10 
bed method III; 

Figure 50 shows a flowchart explaining the 9th 
image data encoding method according to the 
above described embodiment; 
Figure 51 shows a block diagram showing the cir- 1 s 
curt configuration of the 22nd image data encod- 
ing device; 

Figure 52 shows a block diagram showing an- 
other configuration of the 23th image data en- 
coding device encoding image data according to 20 
the method indicated by the flowchart; 
Figure 53 shows a flowchart indicating the 10th 
image data encoding method according to the 
above described embodiment; 
Figure 54 shows a flowchart indicating the 11th 25 
image data encoding method; 
Figure 55 shows a flowchart indicating the 12th 
image data encoding method according to fur- 
ther embodiment of the present invention; 
Figure 56 shows a block diagram indicating the 30 
configuration of the 24th image data encoding 
device; and 

Figures 57A to 57C show each of the configura- 
tion examples of the determination threshold out- 
put unit in the 24th image data encoding device. 35 

Description of the Preferred Embodiment 

The embodiment of the present invention will be 
explained by referring to the drawings. 40 

Figure 6 shows an explanatory view of the first 
image data coding method according to an embodi- 
ment of the present invention. The first image data 
coding unit divides the image data of one frame com- 
prising m x n image elements into a plurality of blocks 45 
(where m and n are integers), and performs a coding 
of the image elements of blocks. 

In Figure 6, the image element in the first block 
of the present frame is compared with the image ele- 
ment of the first block of the preceding frame with the so 
position of the image element and block of the pres- 
ent frame being the same as those of the preceding 
frame, thereby determining whether the frrst block of 
the present frame is a valid block in which the image 
is different from that in the first block of the preceding 55 
frame (S1.S2). 

The determination as to whether it is a valid block 
is performed based on using the following methods 



(1), (2), and (3). 

(1) The sum of the absolute value of the differ- 
ence between the value (for example, brightness 
level value) of the image element in the present 
frame and the present frame is obtained and the 
block with the sum value of the corresponding 
image elements in the same position in the pre- 
ceding frame larger than the predetermined 
threshold value is deemed a "valid block". Ac- 
cording to this method (1), the valid block is de- 
termined based on the total sum of the absolute 
values of the differences between the corre- 
sponding image elements and thus a variation of 
the whole one block can be examined. 

(2) The absolute values of the difference of aD the 
image elements are obtained for respective 
blocks of the present frame. The block in which 
the maximum value of absolute values of the dif- 
ference is more than the specified value can be 
deemed a Valid block". This method (2) has only 
to detect the absolute values of the difference 
and thus determines the "valid value" with a sim- 
ple circuit at a high rate processing. 

(3) The total sum of the squares of the difference 
between the value of the image element in the 
block in the present frame and the value of the 
corresponding image element in the correspond- 
ing block in the same position in the preceding 
frame and only the block whose total sum ex- 
ceeds the predetermined threshold value is 
deemed a "valid block". In this method (3), the va- 
riation of t he image elements is based on the total 
sum of the squares of the difference and thus the 
amount of the variation is emphasized. There- 
fore, the variation within one block can be exam- 
ined from a view point of its effect on an eyesight 
with accuracy. 

Hereinafter, a block which is not a valid block, 
namely, in which the image data does not change 
from that of the preceding frame is expressed as an 
invalid block. 

The result of the determination of the first block 
is outputted as block information representing wheth- 
er the block is a valid block (S3). 

Sequentially, It is determined based on the deter- 
mination result at step S2 whether the image data of 
the first block changes from the preceding frame 
(S4). 

When the image data of the present frame 
changes from that of the preceding frame, the image 
data of the first block is coded (S5), where the first 
block of the present frame is determined as a valid 
block. If the image of the first block does not change 
from t hat of the preceding frame in step S4, the image 
data of the block is not coded. 

The above processes S1 to S5 are repeated with 
regard to all the blocks following the first block of the 
present frame, the block information designating the 
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valid block or the invalid block is outputted for all the 
blocks of the present frame and only the image data 
of the blocks which are determined as being a valid 
block in the present frame are coded. 

When the above processes S1 to S5 are deter- 5 
mined as being completed with regard to all the 
blocks of the present frames in step (S6, YES), the 
coding of the image data of the present frame is com- 
pleted. 

In step S5, the coding may be performed by using to 
an orthogonal transform such as ADCT. By adopting 
such an orthogonal transform, a circuit scale of the 
coder may be made small, and the compression ratio 
can be increased. The block information in step S3 
may be outputted to the information holding unit in the 15 
coding device. When the coding is completed for all 
the blocks of the present frame, the block information 
of all the blocks held in the information holding unit 
may be outputted with the coded data of the valid 
blocks. 20 

When the coded data of the valid blocks is out- 
putted, the number of continuous appearance of the 
invalid blocks up to the next appearance of a valid 
block Is calculated and the number of calculated val- 
ues of the continuous appearance of the invalid 25 
blocks may be outputted as the block information fol- 
lowing the coding data, thereby decreasing the 
amount of the data of the block in the frame informa- 
tion. 

The block information may be coded thereby for 30 
output after it has been compressed. 

As described above, in the image data coding 
method according to the first embodiment, only the 
image data of the valid block in which the image data 
in the block in the present frame changes from the 35 
corresponding one in the corresponding block in the 
preceding frame is selected and encoded, and thus 
the amount of the coded data can be reduced greatly 
in the case of the frame including a large background 
portion in which the image does not change. 40 

As the existence of the change of the image data 
in the block in the present frame from the correspond- 
ing image data in the preceding frame is outputted as 
the block information, the image data restoring side 
can easily determine the block in which the image 45 
changes, thereby accurately restoring the image 
data. 

Figure 7 shows a flow chart for explaining t he first 
image data decoding met hod according to an embodi- 
ment of the present invention. so 

The decoding method designated by a first image 
data coding method decodes the coded data to the 
image data. According to this method, it is determined 
based on the block information whether each of re- 
spective blocks of the frame in which the image is to 55 
be restored is a valid block (S11). 

When the block is the valid block, the coded data 
of the block is restored to the image data (S12). The 



restored image data (restored block image) Is written 
into the predetermined block address of the image 
memory (S13). Then, the write address of the image 
memory is updated to the address of the block which 
should be the next subject of the restoration (S14). 

In step S12, the block is determined as an invalid 
block, the write address for the restoration image is 
updated to the write address of the restoration of the 
next block (S15). The above steps (S11 - S15) are re- 
peated in the predetermined sequence with regard to 
ail the blocks of the restoration frame and when it is 
determined yes that the restoration of the image data 
is completed for all the blocks (S 16, YES), the restor- 
ation operation of the image data of alt the blocks 
within one frame is completed. 

According to the first image data decoding meth- 
od, only the image data of the valid block is restored 
based on the input block information and after the re- 
storation, the image data of the block address corre- 
sponding to the valid block in the image memory is 
updated to the restored image data. With regard to 
the invalid block whose image data does not change 
from that of the preceding frame, the restoration of 
the image data is not performed and the block ad- 
dress of the image memory is merely updated. There- 
fore, this method can restore the image data of one 
frame with a high efficiency at a high speed. 

Figure 8 shows a block diagram of a circuit of the 
first image data coding apparatus according to an em- 
bodiment of t he present invention. 

In Figure 8, block buffer 610 sequentially stores 
the image data of respective blocks of the input pres- 
ent frame in units of blocks. Image buffer 612 stores 
the image data of the reference frame to be used as 
the image data of the preceding frame with regard to 
the image data of respective frames which are input- 
ted sequentially. 

Variation amount calculating unit 614 compares 
the image element in the block in the present frame 
to the corresponding image element in the blocks of 
the reference stored in the image buffer 61 2 and cal- 
culates the amount of the variation of the value of the 
image elements per block. 

Block variation determining unit 616 compares 
the variation amount of the image elements of respec- 
tive blocks inputted and calculated by the variation 
calculating unit 614 with the satisfactory value stored 
in the threshold value storing unit 616a and determi- 
nes whether the image of respective input blocks 
changes from that of the reference frame. When 
there is a valid block whose image changes from the 
reference frame, the block variation determining unit 
616 outputs "1 " and when t here is an invalid block im- 
age which does not change from the reference frame, 
it produces "0" as the decision determination signal. 

Switch 618 outputs the image data of the present 
block stored in block buffer 610 to the two-dimension- 
al OCT transform unit 620 and image buffer 61 2 in ao 
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cordance with the determination result signal input- . 
ted from block determining unit 616. Namely, when 
the block determining unit 616 produces the decision 
result signal designating that the present block is the 
valid block, the image data of the present block held 5 
In the block buffer 610 is outputted to the two-dimen- 
sional DCT transform unit 622 and image buffer 612. 

Image buffer 612 rewrites to the data in the pres- 
ent frame the image data in the block held in the ref- 
erence frame which is provided in the same position 10 
as that of the present block. 

Block information holding unit 620 holds variation 
determining information of all the blocks of the pres- 
ent frame inputted from the block variation determin- 
ing unit 616, namely, T in the case of the valid block 15 
and "0" in the case of invalid block. 

Two-dimensional DCT transform unit 622 per- 
forms an orthogonal transform of the image data of 
respective blocks of the present frame inputted from 
the switch 618 using the two-dimensional discrete oo- 20 
sine transform, thereby providing the two-dimension- 
al DCT coefficients of the special distribution, the 
number of the DCT whose number is equal to the 
coefficients number of the image elements in the 
block, quantizes the two-dimensional DCT coefft- 25 
cient of respective blocks by using the quantizing 
threshold value which is obtained by visual experi- 
mentation and is adapted to the vision and is held 
quantization threshold value holding unit 624a. 

Variable length coding unit 626 encodes the 30 
quantized coefficient obtained by quantization unit 
624 by using the huffman code table stored in the 
huffman coding data which is obtained statistically. 
The coded data obtained by this variable coding 
method is outputted to the coded data holding unit 35 
628. 

In this variable coding method, the quantizing 
coefficient arranged in two-dimensional manner is 
converted to the one-dimensionaJ train of numerals 
by a scanning process called a zigzag scan. As to the 40 
DC component, the difference between the DC com- 
ponent at the head of present block and that of the 
head of the preceding block is subject to the variable 
length coding. As to the AC component the value of 
the valid coefficient (whose value is not zero) is com- 45 
bined with the length of run (run length) of the invalid 
coefficients whose values are zero obtained up to the 
next valid coefficient, thereby being subjected to a 
variable length coding for respective blocks. The code 
data holding unit 628 stores one frame of the coded so 
data of the present frame inputted from the variable 
length coding unit 626. 

Multiplexer MPX 630 selectively outputs the 
block information of the present frame held in the 
block information holding unit 620 and the coded data 55 
of all the blocks of the present frame are stored in the 
coded data holding unit 628. 

Figures 9 A to 9C show an embodiment of the 



block variation determining unit 616. 

Figure 9A shows a block diagram of a circuit 
structure according to one embodiment of the Mock 
variation determining unit 616. Variable absolute val- 
ue calculating unit 6160 calculates the absolute value 
of the variation of the image elements value which is 
inputted from the variation amount calculating unit 
614 and which is determined based on the image val- 
ue at the same position as that in the reference frame 
with regard to the respective image elements of re- 
spective blocks. 

Intra-block maximum value detecting unit 6162 
detects the maximum value A of the absolute value of 
respective blocks from the absolute value of the va- 
riation amount of the image element value of respec- 
tive image elements of respective blocks inputted 
from the absolute value calculating unit 6160. 

Threshold holding unit 616a stores the threshold 
value T1 for determining the invalid/valid block (exis- 
tence of the variation/non-existence of the variation) 
with regard to respective blocks of the present frame. 

When the calculation of the variation amount of 
the image element value regarding all the image ele- 
ments of a block is completed by the absolute value 
calculating unit 6120, the comparing unit 6124 com- 
pares the maximum variation value A in the block 
which is detected by intra-block maximum value de- 
tecting u nit 61 22 with the threshold value T held in the 
threshold holding unit 61 6a and determines the block 
in which the image changes from the reference frame, 
namely, the valid block when the maximum variation 
value A is larger than the threshold value T1 , thereby 
outputting T. The comparing unit 6124 determines 
the block as the block in which the image does not 
change from the reference frame, namely, the invalid 
block if the maximum variation value A is less than the 
threshold value T1, thereby outputting "0" to the 
switch 618 and the block information holding unit 620. 

The embodiment can determine whether the im- 
age has valid from the reference frame with regard to 
respective blocks by using a simple circuit as only the 
absolute value of the variation amount of respective 
image elements of the blocks need to be detected. 

Figure 9B shows a block diagram of a circuit 
structure according to the second embodiment of the 
block variation determining unit 616. In Figure 9B, the 
absolute value calculating unit 6120 and the compar- 
ing unit 6124 are the same as those in the first em- 
bodiment. 

Intra-block accumulating unit 6126 accumulates 
the absolute value of the variation of the image ele- 
ment inputted from the absolute value calculating unit 
6120 and outputs the amount of the variation of the 
respective image element value of all the image ele- 
ments in respective blocks which are obtained 
through the above calculation and outputted to com- 
paring unit 6124. 

Threshold holding unit 616a stores the accumu- 
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lated threshold value T2 for determining the valid/in- 
valid block (existence of change of the image/non-ex- 
istence of change of the image) with regard to respec- 
tive blocks of the present frame. 

When the absolute value calculating unit 6120 s 
completes the above calculation for one block and 
completes of the calculation of the accumulation val- 
ue B, the variation of the image element value of all 
the image elements of the particular block is complet- 
ed by the accumulating unit 61 26, the comparing unit 
6124 compares the accumulated value B with the ac- 
cumulation threshold value T2 held by the threshold 
holding unit 616a. When the accumulated value B is 
more than the accumulation threshold value T2, the 
comparing unit 6124 determines that the image va- 
ries from t he reference frame wit h regard to t he block, 
thereby outputting "1" and when the accumulation 
value B is less than the accumulation threshold value 
T2, the comparing unit 6124 determines that the 
block does not carry any variation, namely, is the in- 
valid block, thereby outputting "0" to the switch 618 
and the block information holding unit 620. This em- 
bodiment determines the valid block or invalid block 
based on the accumulated value of the absolute va- 
riation value of all the image elements within one 
block, thereby checking the variation or the whole 
block. 

Figure 9C shows a block diagram of a circuit 
structure according to the third embodiment of the 
block variation determining unit 616. In Figure 9C, the 
comparing unit 6124 is the same as that in the first 
and second embodiments. The second power calcu- 
lating unit 6128 calculates the square of the variation 
of the image element value inputted from the variation 
and calculating unit 614. 

Intra-block accumulating and adding unit 6130 
accumulates the square inputted from the square cal- 
culating unit 6128 in units of blocks and calculates the 
accumulation value of the square for all the image 
elements within one block. 

The threshold value holding unit 12a stores the 
accumulation threshold value T3 for determining the 
changed (i.e.vatid)/ unchanged (i.e. invalid) block (ex- 
istence of variation in the image/non-existence of va- 
riation in the image) with regard to the respective 45 
blocks of the present frame. 

Second power calculating unit 6128 completes 
the calculation of the square and intra-block accumu- 
lating unit 6130 completes the accumulation calcula- 
tion of the square of all the image elements in a par- 50 
ticular block, comparing unit 6124 compares the ac- 
cumulation value T3 held in the accumulation holding 
unit 616a with the accumulation value C of the square 
of the variation of all the image elements in the block 
subject to the calculation of the intra-block accumu- 55 
lating unit 6130 and determines that the valid block 
when the accumulation value C is larger than the ac- 
cumulation threshold value T3, thereby outputting "1" 



and determines that the block is an invalid block, 
when the accumulation value C is less than the ac- 
cumulation threshold value T3 thereby outputting "0" 
to the switch 618 and the block information holding 
unit 620. 

The third embodiment can determine the valid 
block or the invalid block based on the accumulation 
of the square of the variation of the image element 
value obtained in the block. Thus the variation 
amount is emphasized, thereby determining the va- 
riation within one block with a high precision. 

Figure 1 0 shows a format of coded data output 
from the first image data coding apparatus shown in 
Figure 8. By referring to Figure 10, the operation of 
the first image data coding apparatus will be ex- 
plained. An original image data of one block of the 
present frame is written in block buffer 610 and is out- 
put to variation quantity calculating unit 11. Variation 
quantity calculating unit 11 compares original image 
data of the block with the image data of the block of 
the reference frame stored in image buffer 612 the 
block being provided in the same position as in the 
block of the original image data with regard to the im- 
age element provided in the same position in the cor- 
responding two blocks, thereby outputting the varia- 
tion amount of the image element value to block va- 
riation determining unit 616. 

Block change determining unit 616 with the 
structures shown in any one of Figures 8 determines 
which block is the valid block according to the above 
described method and a signal representing the de- 
termination result (namely, Tin the case of defective 
block and "0" in the case of invalid block) is transmit- 
ted to switch 618 and block information holding unit 
620. 

Block information holding unit 620, based on the 
above determination result signal, holds the block in- 
formation which is set at T in the case of a valid 
block and at "0* in the case of an invalid block with re- 
gard to all the blocks of one frame. Switch 618 trans- 
mits the image data of the valid block held in the block 
buffer 610 to DCT transform unit 622 and to image 
buffer 612, thereby updating the reference image. 

The image data of the block at the same position 
as the valid block in the reference frame held in the 
image buffer 612 is updated to the image data of the 
valid block when the image data of the valid block is 
input 

Two-dimensional DCT transform unit 622 applies 
the secondary discrete cosine transform to the image 
data of the valid block and outputs the two-dimen- 
sional DCT coefficient obtained by such transform to 
quantization unit 624. 

The two-dimensional DCT coefficient is subject 
to a renewal quantization in quantization unit 624 and 
thereafter is subject to the variable length coding unit 
626. The image data of the valid block obtained by the 
variable length coding is held in coded data holding 
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unit 628. 

The above operation is applied to the image data 
of all the blocks of the present frame and accordingly 
the image data of the frame is completed. 

When the coding process for ali the blocks (cal- 5 
culated by 90 x 72 = 6480 blocks per one frame where 
one block comprises 8x8 image elements and one 
frame comprises 720 x 576 image elements in the 
case of PAL system) per one frame is completed, mul- 
tiplexer (MPX) 630 outputs the block information 10 
comprising 6480 bits held in the block information 
holding unit in the case of the PAL system as shown 
in Figure 1 0 and thereafter outputs the coding data of 
the valid block held in coded data holding unit 628. 

As explained above, in the case of receipt of the is 
image data of the new frame, the first image data cod- 
ing apparatus rewrites only the image data in the 
block in the reference frame held in the image buffer 
612 in the same position as in the block in the present 
or new input frame which is determined as the valid 20 
block. 

As described above the first image data coding 
apparatus determines the valid block which valid from 
the image of the corresponding block of the preced- 
ing frame and encodes only the image data of the val- 25 
id block, thereby greatly decreasing the coding 
amount. Upon performance of the coding operation, 
block information designating whether the block is 
the valid block or the invalid block with regard to all 
the blocks of one frame, as well as coded data of the 30 
valid block, is outputted and thus the decoding side 
can recognize the block position of the valid block 
based on the block information, thereby enabling the 
image of the frame to be restored correctly. 

Figure 11 shows a circuit structure of the first irrv 35 
age data restoring unit for restoring the coded data 
produced by the first image data coding apparatus 
into the image data. 

In Figure 11, the multiplexer (DMPX) 640 sepa- 
rates input data into the block information and the 40 
coded data of the valid data and input them to block 
information holding unit 642 and coded data holding 
unit 644. 

Block information holding unit 642 holds the in- 
formation for one frame. The coded data holding unit 4S 
644 is the coded data of the valid block of one frame. 

Variable length restoring unit 646 restores the va- 
riable length coded data to the quantization coeffi- 
cient of the fixed length by referring to the Hoffman 
table obtained statistically and stored in the Hoffman 50 
decoding table holding unit 646a. 

Dequantization unit 648 applies the linear de- 
quantization to the quantization coefficient by using 
the threshold value stored in the dequantization 
threshold value holding unit 648a and transforms the ss 
quantization coefficient into two-dimensional DCT 
coefficients of the space frequency distribution. The 
inverse two-dimensional DCT transform unit 650 ap- 



plies the inverse two dimensional discrete cosign 
transform to the two-dimensional DCT coefficient 
and restores the image data of respective blocks. 

Restoring image holding unit 652 holds one block 
of the image data of the restored block. 

Block information detecting unit 654 detects the 
number of the consecutive invalid block from the 
block information input from the block information 
holding unit 642. 

Address calculating unit 656 skips the addresses 
of the invalid block in accordance with the continua- 
tion of the invalid blocks input from the block informa- 
tion detecting unit 654 and outputs only the block ad- 
dress of the valid block to the frame memory 658. 

Frame memory 658 stores the image data of the 
valid block input from the restoring image holding unit 
652 into the position of the block which is designated 
by the address signal input from the address calcu- 
lating unit 656 and holds the restoration image data 
of one frame, 

A latch circuit 6562 latches a serial number of in- 
valid blocks inputted from the block information cal- 
culating unit 654. 

Upon receipt of the invalid block signal supplied 
from the block information calculating unit 654, the 
update controlling unit 6564 causes the clocking op- 
eration of the clock generating unit to be commenced. 
Then, the clock derived from the clock generating unit 
6560 is supplied to a counter 6566 and an OR gate cir- 
cuit 6568. 

The counter 6566 increments the count value by 
1 every time the clock is entered, and then outputs 
the resultant count value to a comparing circuit 6570. 
The comparing circuit 6570 compares this count val- 
ue with the serial number of invalid blocks latched in 
the latch circuit 6562, and outputs an incident signal 
to the update controlling unit 6564 when both of these 
values become equal to each other. 

When the incident signal is inputted, the update 
controlling unit 6564 interrupts the clocking operation 
of the clock generating unit 6560. 

The OR gate circuit 6566 outputs the clock input- 
ted from the clock generating circuft 6560 to an X-ad- 
dress counter 6572. 

This X-address counter 6572 is such a counter for 
counting a component value (X coordinate) of an im- 
age at a block address along the horizontal scanning 
direction (namely, X direction), and for outputting a 
count value to an AND gate circuit 6576. Then, when 
the X-address counter 6572 counts up the compo- 
nent value at the final address along the horizontal 
scanning direction, this counter outputs a carry signal 
to a Y-address counter 6574. 

This Y-address counter 6574 corresponds to a 
counter for counting a component value (Y coordin- 
ate) of an image along the vertical direction (Y direc- 
tion). This Y-address counter 6574 increments the 
count value by 1 every time the carry signal is sup- 
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plied from the X- ad dress counter 6572, and outputs 
t he resultant count value to the AND gate circuit 6576 
as a value of the Y coordinate. 

An address of each block on the frame memory 
658 may be designated by a block address (X, Y) 
which is defined based on both of the count value X 
of the X-address counter 6572 and the count value Y 
of the Y-address counter 6574. 

When the coincident signal issued from the com- 
paring unit 6570 is inputted, and thereafter the value 
block signal derived from the block information de- 
tecting circuit 654 is inputted, the update control unit 
6564 outputs to the frame memory 658 as a write ad- 
dress of decoded block image data, both of the count 
value X of the X-address counter 6572 and the count 
value Y of the y-address counter 6574, which are de- 
rived from the AND gate circuit 6576. 

Upon completion of the writing of this decoded 
block image data, a block update signal is produced 
from a block image element writing control unit (not 
shown in Figure 12), so that the count value of this X- 
address counter 6572 is incremented by 1 via the OR 
gate circuit 6568 in response to this block update sig- 
nal. 

As described above, based upon the block infor- 
mation received from the first image data encoding 
apparatus, in case of the invalid block, only the block 
address is updated at the high-speed clock generated 
from the clock generating unit 6560, whereas in case 
of the valid block, the block address data about this 
valid block is outputted to the frame memory 658, and 
also the decoded image data about this valid block is 
written into the frame memory 658. Then, in case that 
the decoded image data of this valid block is written, 
when this writing operation is accomplished, the 
block address is updated in response to the block up- 
date signal inputted from the block image element 
writing control unit 

In this way, in case of the invalid block, since only 
the updating of block address is performed, a high- 
speed decoding operation of the frame image data 
can be realized. 

Referring now to the arrangement of the first im- 
age decoding apparatus shown in Figures 11 and 12, 
an image decoding operation thereof will be ex- 
plained. 

Input data having such a format as shown in Fig- 
ure 10, which has been transmitted from the first im- 
age data coding apparatus, is separated into coded 
data and block information by the multiplexer 30. The 
coded data is held in the coded data holding unit 32 
and the block information is held in the block informa- 
tion holding unit 31. 

The variable length coded data held in the coded 
data holding unit 32 is decoded into a fixed length 
quantizing coefficient by the variable length decoding 
unit 33 with employment of the Huffman decoding list 
646a. The structure of this Huffman decoding list 



646a is inverse to that of the precedlngly explained 
Huffman coding list 626a which is utilized when the 
image data is coded by the first image data coding ap- 
paratus. This quantizing coefficient is processed by 

5 the linear d equalization with employment of the de- 
quantizing threshold value 648a by the dequantizing 
unit 648, thereby to be decoded into the two-dimen- 
sional DCT coefficient 

The inverse two-dimensional DCT transforming 

10 unit 650 performs the inverse two-dimensional DCT 
conversion with using the two-dimensional DCT 
coefficient, so that the image data about the valid 
block is decoded. 

Then, the decoded image data of this valid data 

f 5 is once stored in the decoded image holding unit 652. 
On the other hand, the block information stored 
in the block information holding unit 642 is processed 
by the block information detecting unit 654. In other 
words, the block information detecting unit 654 dis- 

20 criminates an appearing sequence of a valid block 
and an invalid block based on the block information. 
Then, when the valid block appears, the block infor- 
mation detecting unit 654 outputs the valid block sig- 
nal to the address calculating unit 656. To the contra- 

25 ry, when the invalid block appears, the block informa- 
tion detecting unit 654 counts the number of invalid 
blocks which appear consecutively, and outputs the 
serial number of invalid blocks counted to the address 
calculating unit 656. At this time, the invalid block sig- 

30 nal is also outputted to the address calculating unit 
656. 

Thus, the block address of the valid block is cor- 
rectly calculated based on the block information, and 
then the decoded image data of this valid block is 
35 written into the relevant position of the frame memory 
658. As a consequence, with respect to the image 
data stored in the frame memory 658, only the image 
data about the valid blocks are updated in the respec- 
tive flames. 

40 As precedingly stated, the address calculating 
unit 656 outputs the write address of the decode im- 
age data about the valid block, which has been stored 
in the decoded image holding unit 652, into the frame 
memory 658 in accordance with the information and 

45 the signal inputted from the block information detect- 
ing unit 654. As a result, the decoded image data of 
this valid block is written into the relevant block pos- 
ition of the frame memory 658 by the block image ele- 
ment writing control unit 

so Figure 1 3 is a schematic circuit block diagram for 
showing an overall arrangement of a second image 
data coding apparatus according to another currently 
preferred embodiment of the present invention. 
It should be noted that the same reference nu- 

55 merals used in the first image data coding apparatus 
will be employed as those for denoting the same cir- 
cuit blocks shown in Figure 13. 

In the second image data coding apparatus of 

14 
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Figure 13, an invalid block number counting unit 670 
counts the quantity of consecutive invalid blocks by 
receiving the judgment result as to whether or not the 
valid block is present, from the block change deter- 
mining unit 616. When the judgment result for the val- 
id block is inputted, the above-described count value 
is outputted to an invalid block information generating 
unit 672, and the switch 618 is controlled so as to en- 
ter the image data of the valid block temporary stor- 
ed in the block buffer 610 into the two-dimensional 
DCT transforming unit 622 and the image buffer 612. 

The invalid block information generating unit 672 
codes the serial number of the invalid blocks supplied 
from the invalid block number calculating unit 670 to 
obtain the coded data which will then be supplied to 
a multiplexer (MPX) 630. 

Next, an operation of the second image data cod- 
ing apparatus with the above-described arrangement 
will now be explained. 

Original image data of one frame is subdivided 
into a plurality of blocks and the image data are input- 
ted in unit of block. Then, the original image data of 
the respective blocks are written into the block buffer 
610, and also are outputted to the change amount cal- 
culating unit 614. The change amount calculating unit 
614 compares image elements of the original image 
data of the block to be inputted with the correspond- 
ing image elements of the image data of the block lo- 
cated at the same position of the block for the refer- 
ence frame stored in the image buffer 612 to obtain 
a change amount of a predetermined image element 
value from this image element comparison, and out- 
puts this change amount to the block change deter- 
mining unit 616. 

The block change determining unit 616 is ar- 
ranged by, for instance, the previously explained cir- 
cuit arrangement as shown in Figures 9A, 9B, and 9C. 
This block change determining unit 616 judges 
whether or not ah inputted block corresponds to a val- 
id block. Then, the block change determining unit 616 
supplies the judgment result to the switch 61 8 and the 
invalid block number counting unit 670. 

An invalid block number counting unit 670 is con- 
structed of, for example, a counter which is reset to 0 
when such a judgment result indicative of a valid block 
is inputted. On the other hand, when another judg- 
ment result representative of an invalid is inputted to 
this counter, the count value thereof is incremented 
by 1 . Then, every time the judgment result indicative 
of the valid block is inputted, this counter outputs the 
resultant count value, namely the serial number of 
valid blocks to the valid block information generating 
unit67Z 

An invalid block information generating una 672 
codes the serial number of the inputted valid blocks 
to produce coded number data which will then be sup- 
plied to a multiplexer 630. 

Upon input of the signal representative of the val- 



id blocks, a switch 618 causes the original Image data 
of the block stored in the block buffer 610 to be furn- 
ished to the two-dimensional DCT transforming unit 
622 and the image buffer 612. 

5 As a consequence, an image buffer 61 2 updates 
the Image data of the block located at the same pos- 
ition as that of the above-described block by newly 
entered original image data. 

The image data of the valid block entered into the 

10 two-dimensional DCT transforming unit 622 is proc- 
essed in a two-dimensional DCT transforming unit 
622, a quantizing unit 624, and a variable length cod- 
ing unit 626 by way of the DCT conversion, linear 
quantization, and variable length coding respectively 

15 in a simflar manner to those of the above-explained 
first image data coding apparatus, so that this Image 
data is converted into coded data having a variable 
length, which will then be inputted to the multiplexer 
630. 

20 Figure 14 shows the multiplexer 630 first outputs 
the coded data on the valid data stored in the coded 
data holding unit 19, and subsequently outputs a 
block end code (EOB). Furthermore, this multiplexer 
630 outputs the coded data about the invalid block 

25 number supplied from the invalid block Information 
generating unit 672. 

As described above, also in the second image 
data coding apparatus, since the valid block whose 
image has been valid with regard to the preceding 

30 frame is derived based upon the image data of the ref- 
erence frame, and then only the image data of this de- 
rived valid block is coded, the entire coding amount 
can be considerably reduced. Also, since both of the 
coded data about the valid block and the serial num- 

35 ber of the invalid blocks are coded and then output- 
ted, the block position of the valid block can be cor- 
rectly recognized at the image decoding side and 
therefore the image can be correctly decoded. 
Furthermore, as the serial number of the invalid 

40 blocks existing among the valid blocks is coded and 
the coded serial number is outputted among the cod- 
ed data of the valid blocks, only the quantity of con- 
secutive invalid blocks may be outputted after the val- 
id block as the block information. As a result, a total 

45 amount of the block information can be reduced In ac- 
cordance with the total number of the valid blocks. 
Accordingly, the data transmission amount of the 
second image data coding apparatus becomes small- 
er than that of the first image data coding apparatus. 

50 Figure 1 5 is a schematic circuit block diagram for 
showing an overall arrangement of a second Image 
data decoding apparatus according to the present in- 
vention. It should be noted that like reference numer- 
als employed for denoting the blocks of Figure 11 rep- 

« resent the same or similar blocks in Figure 15. 

The second image data decoding apparatus de- 
codes the coded data produced from the first image 
data coding apparatus, into image data. 

15 
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A code determining unit 680 discriminates coded 
data of valid data and coded data of an invalid block 
number from input data having a format as represent- 
ed in Figure 14, thereby controlling in Figure 14, 
thereby controlling a swftching operation of a demul- 
tiplexer (DMPX) 640. An invalid block information de- 
tecting unit 682 detects a serial number of invalid 
blocks from the coded data about the invalid block 
number inputted from the demultiplexer 640 and out- 
puts the detected serial number to an address calcu- 
lating unit 656. 

A description will now be made of an operation of 
the second image data decoding apparatus with such 
a circuit arrangement as indicated in Figure 15. 

Under control of the code determining unit 680, 
the input data having the data format indicated in Fig- 
ure 14, which has been transmitted from the second 
image data coding apparatus, is separated into the 
coded data about the valid block and the coded data 
about the invalid block number by the demultiplexer 
640. The coded data about the valid block is inputted 
into the variable length decoding unit 646. In this va- 
riable length decoding unit 646, this coded data Is de- 
coded into a quantizing coefficient having a fixed 
length with employment of a Huffman decoding list 
646a having an opposite structure to that of the cod- 
ing table employed at the coding side. A dequantizing 
unit 648 processes the entered quantizing coefficient 
by way of linear dequantization with employment of 
an dequantizing threshold value 648a to obtain a two- 
dimensional DCT coefficient vslid which will then be 
furnished to an inverse two-dimensional DCT trans- 
forming unit 650. The inverse two-dimensional DCT 
transforming unit 650 performs the inverse two-di- 
mensional DCT conversion with using the entered 
two-dimensional DCT coefficient, thereby decoding 
data. 

These process operations are carried out in unit 
of 1 block, and the decoded image data about a single 
block is once stored in the decoded image holding 
unit 652. 

On the other hand, the decoded data about the 
invalid block number separated from the input data 
and derived from the demultiplexer 640, is inputted to 
the invalid block information detecting unit 682. 

The invalid block number detecting unit 682 de- 
tects the serial number of invalid blocks from the cod- 
ed data and supplies the detected serial number to 
the address calculating unit 656. The address calcu- 
lating unit 656 calculates the block address of the 
frame memory 658 into which the decoded image 
data stored in the decoded image holding unit 652 
should be written in accordance with the information 
about the serial number of the inputted invalid blocks, 
and then furnishes the calculated address to the 
frame memory 658. In the frame memory 658, the de- 
coded image data of the block stored in the decoded 
image holding unit 652 is written in the relevant block 



address thereof. 

As previously described in detail, the second im- 
age data decoding apparatus calculates the block ad- 
dress of the valid block to which the coded data Is 

5 sent, based on the coded data about the invalid block, 
and writes the decoded image data of this valid block 
into the corresponding block position within the frame 
memory 658, whereby the image data located at the 
same position as that of this valid block is updated. 

10 Figure 1 6 is a schematic circuit block diagram for 
showing an entire arrangement of a third Image data 
coding apparatus according to the present invention. 

In Figure 16, it should be understood that the 
same reference numerals used to the blocks shown 

15 in Figure 8 are employed as those for indicating the 
same or similar blocks. 

A binary coding unit 690 binary-codes block in- 
formation stored in a block information holding unit 
620 by way of, for instance, a run length coding and 

20 the like to obtain binary-coded data, and outputs this 
binary-coded data to a multiplexer (MPX) 630. 

Then, an operation of the third image data coding 
apparatus will now be described. 

In the third image coding apparatus of Figure 16, 

25 original data of 1 block in the present frame is written 
into the block buffer 610 and also supplied to the 
change-amount calculating unit 614. The change- 
amount calculating unit 614 compares the image ele- 
ments of this block Image data with the image eie- 

30 ments of the corresponding image data present at the 
same position as that of the reference frame block 
stored in the image buffer 624, thereby obtaining a 
change amount in the image element values. Then, 
the change amount in the Image element values is 

36 outputted from the change-amount calculating unit 
614 to the Mock change determining unit 616. 

The block change determining unit 616 with such 
a circuit arrangement as shown in Figs. 8A, 8B, or 8C, 
will judge whether or riot the relevant block is equal 

40 to the valid block based on t he change amount in the 
image element value, and then outputs this judgment 
result to the switch 618 and the block information 
holding unit 620. 

The block information holding unit 620 sets "1" 

45 when the relevant block corresponds to the valid 
block, and sets "0" when the relevant block corre- 
sponds to the invalid block, and furthermore holds 
this block information with respect to aQ blocks in a 
single frame. On the other hand, the switch 618 sup- 
so plies the image data about the relevant block stored 
in the block buffer 610 to the two-dimensional DCT 
transforming unit 622 and the image buffer 624 when 
such a judgment result indicative of the valid block is 
inputted thereto. As a consequence, the image buffer 

55 624 rewrites the image data about the block located 
at the same position as that of this valid block by the 
image data about this valid block, so that the image 
data of the reference frame is updated. 
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On the other hand, the image data of this valid 
block inputted into the two-dimensional DCT trans- 
forming unit 622 is sequentially processed by way of 
the two-dimensional DCT conversion, linear quanti- 
zation and variable coding in the two-dimensional 5 
DCT transforming unit 622, quantizing unit 624, and 
variable length coding unit 626 in order to be coded. 
Thus, the coded data of the image data about this val- 
id data, which has been obtained by this coding op- 
eration, is held In the coded data holding unit 628. 

When a series of the above-explained process 
operation has been completed with respect to all 
blocks in a single frame, the binary coding unit 690 bi- 
nary-codes the block information about all blocks 
stored in the block information holding unit 620 to ob- 
tain binary-coded data. Thus, this binary coding unit 
690 outputs the binary-coded data about the block in- 
formation to t he multiplexer (MPX) 630. 

Similar to the previous multiplexer shown in Fig- 
ure 5 which outputs the coded data, this multiplexer 
630 first outputs the coded data on the block informa- 
tion inputted thereto from the binary coding unit 690, 
and thereafter outputs to coded data of the valid block 
held in the coded data holding unit 628. 

As previously explained, since such a valid block 
whose image has changed with respect to the pre- 
ceding frame, is extracted based on the image data 
about the reference frame, which has been stored in 
the image buffer 624, and thus only the image data 
of this valid block is decoded, a total coding amount 
can be greater reduced. Also, since together with the 
coded data about the valid block, the block informa- 
tion indicating whether all of the blocks in the frame 
are the valid blocks or the invalid blocks, Is coded and 
the coded data/information are outputted, the block 
positions of the valid blocks can be correctly recog- 
nized atthe decoding side. As a result, the original im- 
age can be correctly decoded. 

As the block information is similarly decoded in 
this third image data coding apparatus, a total coding 
amount can be reduced. 

Figure 17 shows a circuit block diagram of an 
overall arrangement of a third image data decoding 
apparatus according to another currently preferred 
embodiment of the present Invention. The third Image 
data decoding apparatus decodes image data from 
coded data produced from the above-described third 
image data coding apparatus. It should be noted that 
like reference numerals employed in the first image 
data decoding apparatus shown in Figure 11 indicate 
the same or simlar blocks in this third image data de- 
coding apparatus. 

A binary decoding unit 696 decodes the coded 
data about the block information, which has been 
stored via the demultiplexer (DMPX) 640 into the 
block information holding unit 642 and has been cod- 
ed by the third image data coding apparatus, to obtain 
original information. 



A description will now be made of an operation of 
the image data decoding apparatus shown in Figure 
17. The coded data produced from the third image 
data coding apparatus shown in Figure 16, is separat- 
ed by the demultiplexer 640 into the coded data of the 
valid data and the coded data of the block informa- 
tion. Then, the coded data is stored in the coded data 
holding unit 642, whereas the coded data of the block 
information is stored in the block information holding 
unit 654. 

The variable length coded data of the valid data 
stored in the coded data holding unit 644 is decoded 
by the variable decoding unit 646 into a quantizing 
coefficient having a fixed length with employment of 
the Huffman decoding table 646a whose structure is 
inverse with respect to that of the Huffman coding ta- 
ble 626a employed in the coding operation. The quan- 
tizing coefficient is processed by way of the linear de- 
quantization in the dequantlzlng unit 648 with using 
the dequantizing threshold value 648a, thereby being 
converted into the two-dimensional DCT coefficient 
The inverse two-dimensional DCT transforming unit 
650 performs the inverse two-dimensional DCT con- 
version with employment of this two-dimensional 
DCT coefficient so that the image data of the valid 
block is decoded. 

These process operations are carried out in unit 
of a single block, and then the decoded image data 
about the decoded 1 valid block are one stored into 
the decoded image holding unit 652. 

On the other hand, the coded data of the block 
information is decoded by the binary decoding unit 
696 into the original block information which wfll then 
be outputted to the block information detecting unit 
656. Based on this block information, the block infor- 
mation detecting unit 654 detects the block position of 
the valid block and counts the serial number of the in- 
valid blocks among the valid blocks, and also outputs 
the resultant information to the address calculating 
unit 656. Based on the entered information, the ad- 
dress calculating unit 656 calculates the write ad- 
dress of the valid Mock stored in the decoded image 
holding unit 652, within the frame memory 658, and 
then supplies the calculated address data to the 
frame memory 658. The frame memory 658 writes 
the decoded image data about the decoded image 
data about the valid block held in the decoded image 
holding unit 652, intothe block address designated by 
this address signal in accordance with the address 
signal. 

As described above, the block address for the 
valid block is calculated based on the coded data of 
the block information, the decoded image data of this 
valid data is written into the corresponding position of 
the reference frame, and then the image data about 
the reference frame may be updated. 

In this case, since the block information has been 
coded and the coded block information is transmitted, 
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a transmission amount of the coded data may be re- 
duced. 

It should be noted that although the count value 
of the counter 6566 is incremented by the number 
equal to the serial number of the invalid blocks in the 5 
address calculating unit 656 of the above-described 
image data decoding apparatus when the serial num- 
ber of the valid block is entered, alternatively, the 
count value of the X-address counter 6572 may be 
summed with the serial number of the invalid blocks, 
thereby obtaining the block address. 

Furthermore, although both of the image data 
coding apparatus and the image data decoding appa- 
ratus are arranged by the hardware in the above- 
described preferred embodiments, the functions of 
the blocks employed in these apparatus may be exe- 
cuted by a microprocessor and a digital signal proc- 
essor in accordance with a software process. 

In accordance with this preferred embodiment, 
as previously described in detail, a comparison is 
made in unit of a single block between the image data 
of the present frame and the image data of the refer- 
ence frame utilized as the image data of the preced- 
ing frame, whereby a selection is performed only for 
the image data of the valid block whose image has 
changed with respect to the image of the preceding 
frame. Then, since only the image data about this val- 
id block is coded and outputted, the data compression 
rate of such consecutive image data that own a small 
image data that own a small change among these 
consecutive images. As a consequence, averaged 
compression rates about moving images of a televi- 
sion telephone system where a television camera is 
fixedly employed, and moving images of a moving 
whose variations in the successive frames become 
small, may be increased. Also since the block infor- 
mation indicative of the positional information about 
the invalid block is outputted together with the coded 
data of the valid block, the correct position of the valid 
block can be recognized based on this block informa- 
tion, so that the image can be correctly decoded. 

Figure 18 is a flow chart for explaining a second 
image data coding method according to a presently 
preferred embodiment of the present invention. 

In accordance with the second image data cod- 
ing method; image data about a single frame is sub- 
divided into a plurality of sub- blocks having m x n im- 
age elements (symbols V and "n" denote natural 
numbers), and the image data are coded in unit of 
block. Furthermore, two threshold values different 
from each other are employed as a threshold value 
used to judge the above-described valid block. 

In the image data coding method shown in Figure 
16, with regard to the first block (sub-block) in the 
present frame, a comparison is made between the im- 
age elements of this first block and the image ele- 
ments of the corresponding block located at the same 
position as the reference frame (preceding frame), 



thereby calculating a change amount In predeter- 
mined image element values. Then, this change 
amount is compared with the presently selected 
threshold value in order to judge whether or not the 
first block of the present frame corresponds to the 
valid block (step S21). 

In this case, when the change amount in the im- 
age element values becomes greater than the pre- 
sently selected threshold value, It is judged that the 
first block corresponds to the valid block, At a step 
S22, when t he first block is the valid block, change in- 
formation (e.g., "1") indicative of such a valid block is 
outputted. 

Subsequently, another threshold value having a 
small value is selected as the threshold value for de- 
termining the valid block (step S23). Then, after this 
f irst block has been processed by way of the two-di- 
mensional DCT conversion and the quantization, the 
processed first block is coded, and the content of the 
block for the above-described reference frame locat- 
ed at the same position as that of the first block is up- 
dated by the content of the first block (step S24). 

To the contrary, when another judgment is made 
that the first block corresponds to the invalid block at 
the previous step S21 , change information (e.g., "0") 
representative of such an invalid block is outputted 
(step S25). 

Next, the threshold value having a large value Is 
selected as the threshold value used to judge the val- 
id block (step S26). 

Thereafter, the above-explained process opera- 
tions as defined at the steps S21 to S26 will be re- 
peatedly performed with regard to all of the blocks 
subsequent to the second block of t he present frame, 
thereby producing the change information for indicat- 
ing whether the relevant block among all blocks cor- 
responds to the valid block or the invalid block. Also, 
the image data of the valid block are coded and the 
coded image data are outputted. Furthermore, the 
block located at the same position as that of such a 
block which has been judged as the valid block in the 
present frame within the block of the reference frame, 
is rewritten by these valid blocks to update the refer- 
ence frame. 

Then, when a judgment result "YES" at a step 
S27 is made of the above-explained process opera- 
tions defined from the step S21 to the step S26 with 
respect to all blocks within the present frame, the 
coding process of the image data for the present 
frame is completed. 

As previously described m detail, according to the 
second image data coding method, with respect to 
the block located at the same position of the preced- 
ing frame within the respective blocks of the present 
frame, only t he block whose image has changed is se- 
lected as the valid block. Since only the image data 
of this valid block fe coded, a total amount of such cod- 
ed data as images having small movement, for in- 
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stance, a consecutive image of background having a 
small image variation, can be considerably reduced 
with respect to a total amount of entire coded data. 

Further, since the valid block Is judged based on 
the result of determining whether or not the block cor- 5 
responds to the valid block by changing the determin- 
ing threshold value, even when the images are gently 
varied among the blocks, the regions over which the 
images start to change and stop to change can be 
judged as the region for the valid block, so that it is 10 
possible to prevent such a discontinuous movement 
of image from which the valid blocks project. 

Figure 19 shows a circuit diagram of a fourth im- 
age data coding apparatus for coding consecutive im- 
age data which have been produced from the above- is 
explained second image data coding method. 

In Figure 1 9, a block buffer 700 temporarily stores 
the image data in unit of single block, inputted from an 
input terminal 700a. 

A reference frame holding unit 702 is a memory 20 
to store image data of reference frame, the image 
data of this reference frame will be used as image 
data of the preceding frame. 

A block-change determining unit 704 compares 
image elements of block image data of the present 25 
frame which has been stored in the block buffer 700 
with image elements of block image data of the refer- 
ence frame which has been stored in the reference 
frame holding unit 702 and is located at the same pos- 
ition as that of the first-mentioned block image data, so 
thereby calculating change amounts of predeter- 
mined image element values for the respective blocks 
of the present frame with respect to the reference 
frame. Then, this block-change determining unit 704 
further compares the change amount of the image 35 
element values with a threshold value derived from a 
threshold value holding unit 706, thereby determining 
a change in t he images of t he respective blocks of the 
present frame with respective to the reference frame, 
namely determining whether or not the input block is «o 
a valid block. This change amount of the image ele- 
ment values includes either a. maximum value of an 
absolute value for differential image element values 
within the input block, or an accumulated value of ab- 
solute values for all of deferential image element val- 46 
ues within the input block, otherwise an accumulated 
value of squared values for absolute values of all of 
differential image element values within the input 
block. 

A determining-threshold-value holding unit 7006 so 
holds two different sorts of threshold values (wffl be 
referred to "a large threshold value and a small 
threshold value") and selects one of these two 
threshold values in accordance with a threshold-val- 
ue changing signal supplied from the block-change 55 
determining unit 704 to furnish the selected threshold 
value to the block-change determining unit 704. A 
block information holding unit 708 holds change infor- 



mation (information indicating whether an input block 
corresponds to a valid block, or an invalid block) of 
the input block supplied from the block change deter- 
mining unit 704. 

A variable length coding unit 710 codes only the 
image data of the valid block stored in the block buffer 
700 in accordance with the judgment result indicating 
whether or not the respective blocks correspond to 
the valid block, which are entered from the block- 
change determining unit 704. The variable length 
coding unit 710 is constructed of, as shown in Figure 
20, a two-dimensional DCT transforming unit7100fbr 
transforming the transmitted block image by way of a 
two-dimensional discrete cosine conversion into a 
two-dimensional DCT coefficient of a spatial frequen- 
cy distraction, a quantizing unit 7102 for quantizing 
this two-dimensional DCT coefficient with a visually 
adaptive threshold value to obtain a quantizing coef- 
ficient, and a variable length coding unit 7104a for va- 
riable-length-coding the quantizing coefficient based 
on a statistically obtained Huffman table. 

A multiplexer 710 selectively outputs the block in- 
formation about all blocks of the present frame which 
have been stored in the block information holding unit 
708, and the coded data produced from the coding 
unit 710. 

Operations of the image data coding apparatus 
with the above-described arrangement will now be 
explained. 

The image data of the each block for the present 
frame is inputted into the input terminal 700a, and 
then temporarily stored in the block buffer 700. The 
reference frame holding unit 702 stores therein the 
reference image data used to detect whether or not 
there is a change of the image of the present block 
with respect to the image of the preceding frame. 

The block-change determining unit 704 com- 
pares image elements of block image data of the 
present frame which has been stored in the block buf- 
fer 700 with image elements of block image data of 
the reference frame which has been stored in the ref- 
erence frame determining whether or not the input 
block is a valid block. This change amount of the im- 
age element values includes either a maximum value 
of an absolute value for differential image element 
values within the input block, or an accumulated val- 
ue of absolute values for all of differential image ele- 
ment values within the input block, otherwise an ac- 
cumulated value of squared values for absolute val- 
ues of all of differentia) image element values within 
the input block. Then, the block-change determining 
unit 704 supplies the judgment result (indicating eith- 
er a valid block, or an invalid block) to the block infor- 
mation holding unit 708 so as to be stored therein. 

The block-change determining unit 704 outputs a 
reference frame rewriting signal to the reference 
frame holding unit 702 when the judgment result indi- 
cates the valid block. Upon receipt of the reference 
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frame rewriting signal, the reference frame holding 
unit 702 updates the image data of the block located 
at the same position as that of the valid block held 
therein by the image data of this valid block which is 
now stored in the block buffer 700. 

Furthermore, the block-change determining unit 
704 supplies the threshold-value changing signal in 
accordance with the judgment result to the determin- 
ing-threshold-value holding unit 706, and changes 
the threshold value derived from the determining- 
threshold-value holding unit 706 from the large 
threshold value into the small threshold value when 
the judgment result is the valid block, and conversely 
changes it from the small threshold value into the 
large threshold value when the judgment result is the 
invalid block. Also, the block-change determining unit 
704 outputs the judgment result to the variable length 
coding unit 710. The variable length coding unit 710 
reads out the image data of this valid block from the 
block buffer 700 when the input judgment result cor- 
responds to the valid block to code this image data, 
and, to the contrary, does not execute the reading 
and coding operations for the image data of the inval- 
id block when the judgment result corresponds to the 
invalid block. 

The multiplexer 712 sequentially switches the 
block information stored n the block information hold- 
ing unit 708 and the variable length coded data input- 
ted from an ADCT coding unit 71 0 to successively out- 
put the switched data. 

As described above, in accordance with the 
fourth image data coding apparatus, when it is judged 
that the present block is the valid block, the determin- 
ing threshold value is set to the small threshold value, 
and then another judgment is made of the change in 
the image of the subsequent block with respect to the 
reference frame based on this small threshold value. 
To the contrary, when it is judged that the present 
block is the invalid block, the determining threshold 
value is set to the large threshold value, and then a 
check is done of the change in the image of the next 
block with respect to the reference frame based on 
the large threshold value. 

As previously explained, depending upon such a 
fact whether or not the image in the present block is 
varied, the threshold value is selected which is em- 
ployed to judge the image variation occurring in the 
subsequent block, so that the valid block regions 
along the block scanning direction can be consecu- 
tively extracted. As a result, it is possible to suppress 
an unnatural scene of the blocks displayed on the 
screen, which is caused when the valid blocks are in- 
terruptedly continued. 

Referring now to Figures 21 to 23, the above- 
described advantages of the preferred embodiment 
will be described more in detaB. As represented in Fig- 
ure 21A, when the image of the block is gradually 
changed, as compared with that of the preceding 



block, in accordance with the method for determining 
the valid block by comparing the change amount of 
the block with a single threshold value, the following 
difficulties may be produced. That Is, as shown in Fig- 

5 ure 21 B, both of the change starting portion "A" of the 
image and the change ending portion "C" thereof 
wit hin the regions A, B, C would be judged as the "in- 
valid blocks", and only the change peak portion "B" 
would be judged as the "valid block". As a conse- 

io quence, since only the region B is reproduced, or de- 
coded during the image decoding operation, this re- 
gion B may give such an impression that this region 
is projected from the adjoining regions A, C. 

To the contrary, in accordance with the fourth fm- 

15 age coding apparatus of the present invention, as rep- 
resented in Figure 21C, when a judgment is made that 
the image change peak portion B is the valid block, 
since the determining threshold value for the valid 
block is selected to be a low threshold value, the re- 

20 gion C can also be judged as the valid block* so that 
the valid block region may be continued. 

As indicated in Figure 22A, when the block B hav- 
ing a small image change Is solely present within the 
valid block region, if only one threshold value would 

25 be employed as the determining threshold value of 
the valid block, judgments could be made of the valid 
block A, invalid block B and valid block C (see Figure 
22B), so that the valid blocks would be interrupted, 
resulting in an unnatural decoded image. To the con- 

30 trary, in case of the fourth image data coding appa- 
ratus, as illustrated in Figure 22C, when the block A 
is judge as the valid block, the small determining 
threshold valid is selected, so that the block B is also 
judged as the valid block, resulting in a natural decod- 

35 ed image. Thus, the valid block region may be contin- 
ued from the change starting region A to the change 
ending region C. 

Similarly, as indicated in Figure 23A, In case of 
images whose block change amounts are not con- 

40 stant, if only one determining threshold value is em- 
ployed, then the valid blocks appears intermittently 
(see Figure 23B). If the fourth image data coding ap- 
paratus Is employed, as represented in Figure 23C, 
the valid blocks are continued and therefore the im- 

4$ age quality of the decoded image can be improved. 

Figure 24 is a flow chart for explaining a third im- 
age data coding method according to another prefer- 
red embodiment of the present invention. 

Also in this third image data coding method, the 

so image data of each block for t he present frame is com- 
pared with the image data of the block for the preced- 
ing frame, which is located at the same position of the 
first-mentioned block, whereby a judgment Is made 
as to whether or not each block of the present frame 

59 is the valid block (step S31 ); Then, in case of the valid 
block, for instance, the change information of "1" is 
outputted (step S2), and one threshold value having 
a small value is selected as the determining threshold 
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value of the valid block (step S33). 

On the other hand, in case of the invalid block, for 
example, the change information of "0" is outputted 
(step S34), and thereafter the other threshold value 
having a large threshold value is selected as the 5 
threshold value for the valid block (step S35). 

The featured process of this third image data 
coding method is processes defined after the step 
S36. That is, when it is judged that the present block 
corresponds to the valid block, after the process op- 10 
eration of the previous step S33 has been performed, 
another judgment is again made as to whether or not 
the preceding block is the valid block by employing 
the small threshold value selected at the step S33. 

Then, when the preceding block is the valid 15 
block, the change information of this preceding block 
is set to, for instance, T (step S37). As a result, if the 
preceding block has been judges as the invalid block 
at the previous step S31, then the change informa- 
tion thereof is changed from, for example, "0" to "1". 20 
In other words, the preceding block is changed from 
the invalid block into the valid block. Then, this pre- 
ceding block which has been judged as the valid block 
is coded (step S38). 

On the other hand, subsequent to the above step 25 
$35, another judgment is made whether or not the 
preceding block corresponds to the valid block (step 
S39). Then, If the preceding block is the valid block, 
then the image data of the preceding block is coded 
(step S40). 30 

As described above, when a judgment is made 
that the present block corresponds to the valid block, 
the threshold value used for determining the valid 
block is reduced, and a check is done whether or not 
the preceding block corresponds to the valid block. 35 
Then, as a result of this judgment, when such a judg- 
ment is made that the preceding block is the valid 
block, the change information of the preceding block 
is set to "1 " indicative of being the valid block, and the 
image data of this preceding block Is coded. 40 

On the other hand, when the present block cor- 
responds to the invalid block, the threshold value for 
determining the valid block is increased. Then, if the 
preceding block is the valid block, then the image 
data of this preceding block is coded. 45 

When a series of process operations as defined 
from the step S31 to S40 have been accomplished as 
to the present frames of afl blocks (step S41), a check 
is done as to whether or not the final block of the pres- 
ent frame corresponds to the valid block (step S42). 50 
rf the final block corresponds to the valid block, then 
the image data of this final block is coded (step S43). 

Figure 25 is a schematic block diagram for indi- 
cating a circuit arrangement of a fifth image data cod- 
ing apparatus for coding a consecutive image by way 55 
of the above-described third image data coding meth- 
od. It should be understood that the same reference 
numerals used to represent the circuit blocks in the 



fourth image data coding apparatus shown in Figure 
1 9 are employed to indicate the same or simBar circuit 
blocks in Figure 25. 

In the fifth image data coding apparatus of Figure 
25, a preceding block holding unit 242 holds the im- 
age data of the block (namely, preceding block) prior 
to the image data of the present block which has been 
stored in the block buffer 700. Similar to the block 
change determining unit 704 employed in the fourth 
image data coding apparatus, a block change deter- 
mining unit 722 corresponds to such a circuit for de- 
termining whether or not each of the blocks in the 
present frame is a valid block. When this block 
change determining unit 72 judges that the present 
block stored in the block buffer 700 is the valid block, 
the determining unit 72 outputs a preceding block re- 
checking signal to the preceding block holding unit 
724. 

Next, a description will now be made of opera- 
tions of the fifth image data coding apparatus with 
the above-described circuit arrangement 

The image data of the respective blocks in the 
present frame are entered from the input terminal 
700a into the block buffer 700 so as to be temporarily 
stored therein. The reference frame holding unit 702 
holds the image data of the reference frame which is 
used to detect whether or not there is a change in the 
image of the block in the present frame with respect 
to the image of the corresponding block in the pre- 
ceding frame. The blocks in the present frame are 
stored in the block buffer 700. 

The block change determining unit 722 reads out 
the image data of the relevant block of the reference 
frame from the reference frame holding unit 702. The 
relevant block is located at the same position as that 
of the present block stored in the block buffer 700. 
Furthermore, the block change determining unft 722 
compares image elements of the image data of the 
relevant block in the reference frame with image ele- 
ments of the image data of the present block, which 
are located at the same positions, and then calculates 
a change amount of the block based on change 
amounts in these image elements, namely a so-caled 
"a block change amount* (for example, a maximum 
value of absolute values for the above-explained 
change amount, an accumulated amount of absolute 
values for all image elements, an accumulated 
amount of squared values of the change amounts for 
all image elements. Furthermore, the block change 
determining unit 722 compares this block change 
amount with the threshold value outputted from the 
determining threshold value holding unit 706, thereby 
determining whether or not the present block corre- 
sponds to the valid block (namely, a block whose 
change amount is greater than the threshold value). 

Then, when the present block corresponds to the 
valid block, the block change determining unit 722 
outputs a reference frame rewriting signal to the ref- 
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erence frame holding unit 702. Upon receipt of this 
reference frame rewriting signal, the reference frame 
holding unit 702 updates the image data of the block 
in the reference frame held therein, located at the 
same position as that of the present block, by the im- 
age data of the present block stored in the block buf- 
fer. 

In addition to the above operation, the block 
change determining unit 722 outputs a threshold val- 
ue changing signal corresponding to the judgment re- 
sult to the determining threshold value holding unit 
706, and performs such a control that when the judg- 
ment result is the valid block, the threshold value de- 
rived from the determining threshold value holding 
unit 706 becomes a small threshold value, whereas 
when the judgment result is the invalid block, the 
threshold value derived from the determining value 
holding unit 706 becomes a large threshold value. 

Moreover, the block change determining unit 722 
reads out the image data of the preceding block from 
the preceding block holding unit when the judgment 
result is the valid block, and compares the image data 
of this preceding block with the image data of the 
block in the reference frame in the above-described 
manner, the block of the reference frame being locat- 
ed at the same position as the block of the preceding 
block held in the reference frame holding unit 702, 
whereby a recheck is made as to whether or not the 
preceding block corresponds to the valid block. 

Then, when the block change determining unit 
722 judges that the preceding block is the valid block, 
the determining unit 722 sets the judgment result 
(change information) of this preceding block to the 
valid block (for instance, "1"), and outputs the set 
change information to the block information holding 
unit 708 and the coding unit 710. On the other hand, 
when the block change determining unit 722 judges 
that the preceding block is the invalid block, this de- 
termining unit 722 outputs the judgment result 
(change information) of the preceding block held 
therein to the block information holding unit 708 and 
the coding unit 710. 

When the judgment result of the valid block is de- 
rived from the block change determining unit 722, the 
variable length coding unit 710 codes the image data 
of the preceding block held in the preceding block 
holding unit 724 and then outputs the coded image 
data to the multiplexer (MPX) 712. Conversely, when 
the judgment result of the invalid block is derived from 
the block change determining unit 72, the variable 
length coding unit 72 does not execute the above- 
described coding operation. 

The multiplexer 712 sequenttaDy switches the 
change information about the respective blocks held 
in the block information holding unit 708 and the va- 
riable code data about the respective blocks inputted 
from the variable length coding unit 15, and succes- 
sively outputs the above-described two sorts of infor- 



mation. 

As described above, in the fifth image data cod- 
ing apparatus, when a judgment is made that the 
present block is the valid block, the determining 

5 threshold value of the valid block is set to the small 
threshold value, and the image change of the preced- 
ing block is rechecked based on this small threshold 
value. Then, when another judgment is made that the 
preceding block is the valid block during this recheck- 

10 ing operation, the change information of the preced- 
ing block is set to the valid block. On the other hand, 
when a judgment is done that the present block is the 
invalid block, the determining threshold value of the 
above-explained valid block Is set to the large thresh- 

15 old value in order to judge the image change of the 
next block. 

As described above, a selection is made of the 
determining threshold values for the valid block 
based on such a fact whether or not the present block 

20 is the valid block, namely whether or not there is an 
image change in the present block. When it is judged 
that the present block is the valid block, the preced- 
ing block is rechecked based on the small threshold 
value whether or not this preceding block corre- 

25 sponds to the valid Nock. As a result, even when the 
image is gradually changed within a certain region, 
the valid block can be properly judged. 

Such an effect will now be explained with refer- 
ence to Figures 21 to 23. 

30 First, as represented in Figure 21A, If the Image 
of the block like a portion constructed of the regions 
A, R, C is gradually varied, when the judgment of the 
valid block would be carried out based on a single 
threshold value, both of the change starting region A 

35 and the change ending region B would be judged as 
the invalid blocks, and only the image change peak 
region B would be judged as t he valid block (see Fig- 
ure 21 B). As a result, it may be felt that the region B 
corresponding to the valid block is projected from the 

40 adjacent regions A and C. 

To the contrary, in case of the fifth image data 
coding apparatus, as illustrated in Figure 21 E, when 
a judgment Is made that the image change peak re- 
gion B is the valid block, the determining threshold 

45 value of the valid block is changed into the small 
threshold value. Thereafter, since the region A is 
again checked as to whether or not this region A is the 
valid block based on this small threshold value, it can 
be judged that this region A corresponds to the valid 

so block. As a consequence, as shown in Figure 21 E, the 
consecutive region from the image change starting 
region A to the image change ending region B may be 
judged as the valid block region. Therefore, since the 
images of the regions A, B, C are varied together dur- 

55 ing the image decoding operation, a natural image re- 
production could be realized. 

Further, as represented in Figure 22A, when a re- 
gion B having a smaD image variation is solely present 
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within a consecutive region whose image has been 
changed with respect to the image of the preceding 
frame, in case that only one determining threshold 
value of the valid block is employed, the following 
judgment result is obtained. The region A is the valid 5 
block, the region B is the invalid block, and the region 
C is the valid block, so that the regions of the valid 
block are interrupted, which gives such an impression 
that an unnatural decoded image is observed during 
the image is observed during the image decod- 10 
ing/representing operations. However, in accordance 
with the fifth image data coding apparatus, as illu- 
strated in Figure 22C, since the region B is also 
judged as the valid Nock, a consecutive region from 
the image change starting region to the image 15 
change ending region can be judged as the valid 
block. As a consequence, since any of the regions A, 
B and C are varied during the decoding/displaying op- 
erations, a natural decoded image can be obtained. 

Similarly, as illustrated in Figure 23A, in such a 20 
consecutive region whose block change amount is not 
constant when only one determining threshold value 
for the valid block is utilized, the regions judged as the 
valid block are interrupted (see Figure 23A). To the 
contrary, in accordance with the fifth image data cod- 25 
ing apparatus, as shown in Figure 23D, since a judg- 
ment is made that a consecutive region from the im- 
age change starting region to the image change end- 
ing region is the valid block, the image quality of the 
decoded image thereof can be improved. 30 

Figure 26 is the flowchart indicating the 4th im- 
age data encoding method according to the embodi- 
ment of t he prese nt invention. 

In this encoding method, two thresholds each 
having a different value are used as a valid or block 35 
determination threshold. 

According to this encoding method, a threshold 
having a smaller value (a smaller threshold) is select- 
ed as a valid block determination threshold (S51). 

First, it is determined using the smaller threshold 40 
whether or not the present block is valid or (S52). If 
yes, a threshold having a larger value (a larger 
threshold) is selected as a valid or block determina- 
tion threshold (S53). 

Then, it is determined using the larger threshold 45 
whether or not the succeeding block is valid (S54). If 
yes, a value indicating that the present block is valid 
(T, for example) is outputted to change information 
on the present block (S55). Next the image in the 
present block are encoded (S56). so 

If it is determined that the succeeding block is in- 
valid in step S54, then a value indicating that the 
present block is invalid (*0*, for example) is outputted 
as change information on the present block (S57). In 
this case, t he image data in the present block are not 66 
encoded. 

The processes in steps S51 through S57 are per- 
formed on all blocks in a frame. If the change infor- 



mation has been outputted for the second block from 
the last ("Yes" in S58), then ft is determined using a 
smaller threshold whether or not the last block is valid 
(S59). Only if it is determined that the block is valid, 
the image data in the last block are encoded (S60). 

Thus, in this encoding method, It Is determined 
using the smaller threshold whether or not the pres- 
ent block is valid. If yes, it is determined using the 
larger threshold whether or not the succeeding block 
is valid. Only if it is determined that the succeeding 
block is valid, it is determined that the present block 
is valid, a value indicating that the present block is 
valid is set and outputted to the change information 
on the present block, and the image data in the pres- 
ent block are encoded. That is, also in this encoding 
method, the data in a valid block can be encoded. 

Figure 27 is the block diagram indicating the cir- 
cuit configuration of the 6th image data encoding de- 
vice for encoding image data in a frame in block units 
according to the 4th image data encoding method. 

In Figure 27, a block which also appears in the 
block diagram indicating the 4th image data encoding 
device shown In Figure 19 is given the number as- 
signed therein. 

A present block buffer 732 stores image data in 
the present block whose data are to be encoded. 

A succeeding block buffer 734 stores image data 
in the succeeding block applied through input termi- 
nal 700a. 

A block change determining unit 736 determines 
using a smaller threshold applied by the determina- 
tion threshold value storing unit 708 whether or not 
the above described present block is valid according 
to the image data in the present block stored Hi the 
present block buffer 732 and to the image data in the 
reference frame stored in the reference frame storing 
unit 701. If the determination indicates that the pres- 
ent block is valid, then the block change determining 
unit 736 determines using a larger threshold applied 
by the determination threshold value storing unit 706 
whether or not the succeeding block is valid accord- 
ing to the image data in the succeeding block stored 
in the succeeding block buffer 734 and to the image 
data in the reference frame stored in the reference 
frame storing unit 701. If the determination indicates 
that the succeeding block is valid, then the determi- 
nation result is outputted to the block information stor- 
ing unit 708 and the encoding unft 710 as the change 
information on the present block. 

That is, the block change determining unft 736 
reads from the reference frame storing unit 732 the 
image data in the block, located at the position cor- 
responding to that of the present block stored in the 
present block buffer, in the reference frame, com- 
pares picture elements in the image data in the pres- 
ent block with those in the block in the reference 
frame, obtains a variation in a block according to the 
variation of each picture element (for example, the 
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maximum value in a block, an accumulative value of 
absolute values of the above described variations of 
all picture elements, an accumulative value of square 
numbers of the variation of all picture elements, etc.), 
compares the block variation with a smaller threshold 5 
applied by the threshold storing unit 706, and deter- 
mines whether or not the present block is valid after 
determining whether or not the block variation is larg- 
er than the smaller threshold. 

Then, if the determination result indicates a valid 
block, then the block change determining unit 736 in- 
ternally stores change information indicating a valid 
block, outputs a threshold change signal to the deter- 
mination threshold storing unit 706, and switches 
thresholds outputted by the determination threshold 
storing unit 706 from a smaller threshold to a larger 
threshold. 

The block change determining unit 736 reads im- 
age data In the succeeding block from the succeeding 
block buffer 734, reads from the reference frame stor- 
ing unit 701 the image data in the block, located at the 
position corresponding to that of the succeeding 
block, in the reference frame, and then calculates the 
block variation as described above. The block varia- 
tion is compared with a larger threshold applied by 
the determination threshold storing unit 706, and it is 
determined whether or not the succeeding block is 
valid. 

Then, if the block change determining unit 736 
determines that the succeeding block is valid or valid, 
then it determines that the present block is valid, and 
outputs the determination result of the present block 
(indicating a significant block) to the block informa- 
tion storing unit 708 and the encoding unit 710. If the 
block change determining unit 736 determines that 
the succeeding block is invalid, then it turns the de- 
termination result of the present block to "an invalid 
block", and outputs it to the block information storing 
unit 708 and the encoding unit 710. 

When the block change determining unit 736 de- 
termines that the present block is a valid or valid 
block, then it outputs a reference frame rewrite signal 
to the reference frame storing unit 701 . On receiving 
the signal, the reference frame storing unit 701 up- 
dates the image data in the block in the reference 
frame to the data in the corresponding block in the 
present block. 

On receiving a determination result from the 
block change determining unit 736, the encoding unit 
710 reads the image data in the present block from 
the block buffer 732, encodes the image data in the 
present block, and outputs them to the multiplexer 
(MPX) 712. However, if the determination result indi- 
cates an invalid block, the encoding unit 710 encodes 
no image data in the present block. 

The multiplexer 712 sequentially switches and 
outputs change information on each block applied 
from the block information storing unit 708 and vari- 



able-length encoded data of a valid block received 
from the encoding unit 710. 

Thus, with the 6th image data encoding device, 
when the present block is determined using a smaller 
determination threshold that it is a valid block, it is fur- 
ther determined using a larger determination thresh- 
old whether or not the succeeding block is valid. If 
yes, it is determined that the present block is valid. If 
no, it is determined that the present block is invalid. 

The operation of the 6th image data encoding de- 
vice is explained by referring to Figures 21 through 
23. 

As described above, if a block image indicates a 
moderate change from Its preceding frame, and if a 
valid block determination is made using a single 
threshold for areas A, B, and C, then an Image 
change starting area A and an image change ending 
area C where a change in images from its preceding 
frame is relatively moderate are determines to be in- 
valid blocks, and only an image change peak area B 
is determined to be a valid block as shown in Figure 
21B. Therefore, the only valid block B is displayed 
conspicuously when an image is reconstructed, re- 
sulting in an unnatural image. 

With the 6th image data encoding device, If area 
A is determined to be valid using a smaller threshold 
as shown in Figure 21 D, then it is determined using 
a larger threshold whether or not area B, that is, the 
succeeding block, is valid. Therefore, an area indicat- 
ing a change in images from the preceding frame can 
be appropriately detected, and the adjacent areas A 
and B can be determined to be valid. As a result, a 
natural image is obtained after an original image is re- 
constructed. 

Furthermore, as shown in Figure 22A, if adjacent 
areas indicates a change in images from the preced- 
ing frames, and if the image changes moderately at 
the central portion of the areas, then determining a 
valid block using a single threshold determines that 
area A Is valid, area B invalid, and area C valid or valid. 
Then, the reconstructed image looks unnatural at 
area B. 

On the other hand, with the 6th image data en- 
coding device, area B is determined to be valid using 
a smaller threshold, and area C is determined to be 
valid using a larger threshold. Therefore, area B is de- 
termined to be valid. As a result, as shown in Figure 
22D, the adjacent areas B and C can be determined 
to be valid, thereby reconstructing a more natural im- 
age. 

Next, Figure 28 is the flowchart indicating the 5th 
image data encoding method. 

In this encoding method, two thresholds are 
used to determine whether or not a block is valid. 

That is, first, a threshold having a larger value (a 
larger threshold) is selected as a valid block determi- 
nation threshold (S71). Using the larger threshold, it 
is determined whether or not the present block is vaJ- 
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id (S72). If yes, a value indicating that the present 
block is valid ("1", for example) is set and outputted as 
change information on the present block (S73), and 
the image data in the present block are encoded 
(S74). 

If it is determined that the present block is valid 
in step S72, then a smaller threshold is selected as a 
valid block determination threshold (S75). Then, it is 
determined using the smaller threshold whether or 
not the present block is valid (S76). If no, a value in- 
dicating that the present block is invalid ("0", for ex- 
ample) is set and outputted as change information on 
the present block (S77), and the image data in the 
present block are not encoded. 

In step S76, if it is determined that the present 
block is a valid block, then the larger threshold is se- 
lected as a valid block determination threshold (S78), 
and it is determined whether or not the preceding 
block is valid (S79). 

If it is determined that the preceding block is valid 
in the determination, it is determined that the present 
block is valid, and the processes in steps S73 and 
S74 are performed. 

On the other hand, if it is determined that the pre- 
ceding block is invalid in step S78, then it is deter- 
mined using the larger threshold whether or not the 
succeeding block is valid (S80). If yes, it is determined 
that the present block is valid, and the processes in 
step S73 and S74 are performed. 

If it is determined that the succeeding block is 
valid in step S80, then the present block is considered 
to be valid, and only the process in step S77 is per- 
formed. 

If the processes in steps S71 through S80 are 
performed on all blocks in one frame, and if the proc- 
esses in steps S71 through S80 have been completed 
for all blocks ("Yes" in S81), then the image data in the 
frame are performed. 

If it is determined in step S79 that the preceding 
block Is invalid during the determination of the last 
block in a frame, then it is determined that the last 
block is invalid, and the process in step S77 is per- 
formed immediately. 

If it is determined in step S76 that the present 
block is valid during the determination of the leading 
block, then the process in step S80 is performed im- 
mediately after step S78. 

Figure 29 is the block diagram indicating the gen- 
eral configuration of the 7th image data encoding de- 
vice for encoding a series of images by the above de- 
scribed 5th image data encoding method 

In Figure 29, if a block also appears in the dia- 
grams of the 5th and 6th image data encoding devic- 
es shown in Figures 25 and 27 respectively, then the 
block is given the number assigned in these figures. 

A block change determining unit 742 receives the 
image data in the present block from the present 
block buffer 732, the image data in the preceding 
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block from the preceding block buffer 724, and the Im- 
age data in the succeeding block from the succeeding 
block buffer 734. The block change determining unit 
742 sequentially reads from the reference frame stor- 
5 ing unit 701 image data in the blocks located at the 
positions of the above described present, preceding, 
and succeeding blocks. Then it determines using a 
larger and/or smaller thresholds received from the de- 
termination threshold value storing unit 706 and ac- 
10 cording to the procedure shown in the flowchart 
shown in Figure 28 whether or not the present block 
indicates a difference from that in the reference 
frame, and is valid. 

Next, the operation of the 7th image data encod- 
es ing device shown in Figure 29 is explained. 

Image data in each block in a frame are applied 
through input terminal 700a and temporarily stored in 
the succeeding block buffer 734, and then stored in 
the present block buffer 732. When the image data In 
20 t he present block have been encoded, they are trans- 
ferred to the present block buffer 732, and stored 
therein as the image data in a new present block. The 
Image data in the present block stored in the present 
block buffer 732 are transferred to the preceding 
25 block buffer 724 immediately after being encoded, 
and stored as the image data in a new preceding 
block. 

When determining whether or not the present 
block whose image data are stored in the present 

do block buffer 732 is valid, the block change determin- 
ing unit 742 reads from the reference frame storing 
unit 701 the image data in the block, located at the 
position cor responding to that of the present block, of 
the reference frame, compares the image data in the 

35 block in the reference frame with the image data in 
the present block stored in the present block buffer 
732 by collating picture images at the corresponding 
positions, and obtains the difference in picture ele- 
ment value for each image picture element Then, the 

40 difference in block units (for example, the maximum 
absolute value of the difference in a block, the accu- 
mulative value of absolute values of differences for all 
picture elements in a block, the accumulative value of 
square numbers of differences for all picture elements 

45 in a Mock, etc.) is obtained. Then, the difference in a 
block is compared with a larger threshold provided by 
the determination threshold storing unit 706, and 
then it is determined whether or not the present block 
is valid. That is, if the above described difference in 

50 a block is equal to or larger than the larger threshold, 
then it is determined that the present block is valid. 

Thus, if the block change determining unit 742 
determines that the present block is valid, then it out- 
puts the determination result to the block information 

55 storing unit 708 and the encoding unit 710. Then, the 
encoding unit 710 encodes the image data in the 
present block stored in the present block buffer 732, 
and outputs the encoded data to the multiplexer 

25 
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(MPX)712. 

On the other hand, the block information storing 
unit 708 sets a value indicating that the present block 
is valid ("1", for example) as block information on the 
present block, and stores it as present block informa- 
tion (change information). 

If the block change determining unit 742 determi- 
nes that the present block is invalid, it outputs a 
threshold change signal to the determination thresh- 
old storing unit 706. Then, the determination thresh- 
old storing unit 706 switches thresholds from the larg- 
er to the smaller and outputs the smaller threshold. 

The block change determining unit 742 determi- 
nes again using the smaller threshold according to 
the above described procedure whether or not the 
present block is valid. 

If the block change determining unit 742 determi- 
nes that the present block is invalid, then it outputs 
the determination result to the block information stor- 
ing unit 708 and the encoding unit 710. 

Then, the block information storing unit 708 sets 
and stores a value indicating that the present block is 
invalid ("0", for example) as present block information 
(change information). 

If the block change determining unit 742 determi- 
nes using the smaller threshold that the present lock 
is valid, then it outputs a threshold change signal 
again to the determination threshold storing unit 706, 
and has the determination threshold storing unit 706 
output the larger threshold again. 

Then, the block change determining unit 742 
reads the image data in the preceding block from the 
preceding block buffer 724, reads from the reference 
frame storing unit 701 the image data in the block, lo- 
cated at the position corresponding to that of the 
present block, in the reference frame, and then deter- 
mines using the larger threshold whether or not the 
preceding block is valid as in the determination of the 
present block. 

If the block change determining unit 742 determi- 
nes that the preceding block is valid, it is determined 
that the present block is valid, and the unit outputs 
the determination result to the Wock information stor- 
ing unit 708 and the encoding unit 710. Then, the en- 
coding unit 710 encodes the image data in the pres- 
ent block stored in the present block buffer 732. 

The block information storing unit 708 sets and 
stores a value indicating t hat the present block is valid 
as block information on the present block (change in- 
formation). 

If the block change determining unit 742 determi- 
nes that the preceding block is invalid, then it reads 
the image data in the succeeding block from the suc- 
ceeding block buffer 734, compares the image data 
in the succeeding block with the image data in the 
block, located at a position corresponding to that of 
the succeeding block, in the reference frame, and de- 
termines using the larger threshold whether or not 



the succeeding block Is valid. 

Thus, if the block change determining unit 742 
determines the succeeding block is valid, then it de- 
termines that the present block is valid, and outputs 
5 the determination result to the block information stor- 
ing unit 708 and the encoding unit 710. 

Thus, the block information storing unit 708 and 
the encoding unit 710 perform the above described 
processes. 

io If the block change determining unit 742 determi- 
nes that the succeeding block is invalid, then it deter- 
mines that the present block is invalid, and outputs 
the determination result to the block information stor- 
ing unit 708 and the encoding unit 710. 

is As a result the block information storing unit 708 
sets and stores a value indicating that the present 
block is invalid as present block information (change 
information). The encoding unit 710 does not encode 
the image data in the present block stored in the pres- 

20 ent block buffer. 

If the block change determining unit 742 determi- 
nes that the present block is valid, then it outputs a 
reference frame rewrite signal to the reference frame 
storing unit 701. The reference frame storing unit 701 

25 updates the image data in its block located at the pos- 
ition corresponding to that of the present block to the 
image data in the present block. 

If the update has been completed, the image data 
of the present block stored in the present block buffer 

30 732 are transferred to the preceding block buffer 724, 
and then the image data of t he succeeding block stor- 
ed in the succeeding block buffer 734 are transferred 
to the present block buffer 732. Next, the image data 
in a new block are entered through input terminal 

35 700a, and applied to and stored in the succeeding 
block buffer 734. 

The multiplexer 71 2 alternately switches block in- 
formation of each block stored in the block informa- 
tion storing unit 708 and variable-length encoded 

40 data of a valid block applied from the encoding unit 
710, and sequentially outputs them. Thus, with the 
7th image data encoding device, it is determined us- 
ing a larger threshold that the present block is valid 
if its Image is considered to have been changed from 

45 that of the preceding frame (reference frame). 

If it is determined using a larger threshold that 
the present block is invalid, then it is determined us- 
ing a smaller threshold whether or not the image in 
the present frame has been changed from that in the 

50 preceding frame (reference frame). If, according to 
the determination, it is determined that the present 
block is valid, then it is determined using a larger 
threshold whet her or not the preceding or succeeding 
block is valid. If according to the determination, the 

55 preceding or the succeeding block is valid, then it is 
finally determined that the present block is valid. 

Since the present block is thus considered to be 
valid, blocks can be validly set at the area where an 
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image indicates a moderate change from that in the 
preceding frame, or at a series of areas where differ- 
ences in images are not constant. 

Next, the operation of the 7th image encoding de- 
vice is explained concretely by referring to Figures 21 
through 23. 

First as shown in Figure 21 A, if it is determined 
whether or not a block is valid in a series of areas A, 
B, and C where a change in an image raises moder- 
ately from that in the preceding frame and then re- 
duced moderately, it is determined that both image 
change starting area A and image change ending 
area C refer to invalid blocks, whQe it is determined 
that only area B where the image change indicates its 
peak refers to a valid block as shown in Figure 21B. 
Therefore, when the series of areas are reconstruct- 
ed and displayed, images are changed in area B only, 
while the same images are displayed for the present 
and preceding frames, thereby displaying unnatural 
images totally. 

On the other hand, with the 7th image data en- 
coding device, it is determined using a larger thresh- 
old that area A is invalid and then using a smaller 
threshold that it Is a provisional valid block. Since ft 
is determined using a larger threshold that the suc- 
ceeding block, that is, area B, is valid block, it is de- 
termined that area A is valid finally. Likewise, al- 
though it is determined using a larger threshold that 
area C is invalid, it is determined using a smaller 
threshold that it is valid provisionally. Then, since it is 
determined using a larger threshold that the preced- 
ing block, that is, area B, is valid, it is determined that 
area C is valid finally. Thus, with the 7th image data 
encoding device, images change in areas A and C 
where images change moderately from those in the 
preceding frame, and it is determined that all series 
of areas A, B, and C are valid as shown in Figure 21 E. 
As a result, when images are reconstructed, all data 
In areas A, B, and C are reconstructed, thereby dis- 
playing more natural images. 

As shown in Figure 22A, if a change in an image 
is more moderate in the central portion than in its ad- 
jacent end portions A and B, it is determined that only 
the above described central area B is invalid when a 
valid block determination is made using a single 
threshold as shown in Figure 22B. Therefore, the 
original image cannot be naturally displayed in 
smooth lines because image-changed areas are in- 
tercepted by an image-unchanged area when the 
original image is reconstructed and displayed. 

On the other hand, with the 7th image data en- 
coding device, it is determined using a larger thresh- 
old that area B is invalid, but that it is valid when a 
smaller threshold is used. Since it is determined using 
a larger threshold that area A, that is, the preceding 
block of area B, is valid, it is determined that area B 
is finally valid. As a result, as shown in Figure 22C, it 
is determined that all areas A, B, and C are valid. 



Therefore, images are changed in all adjacent areas 
A, B, and C when the original image is reconstructed 
and d splayed. Thus, a naturally reconstructed image 
can be displayed. 
5 As shown in Figure 23A, in the series of areas 
where the variation in image between preceding and 
present frames (variation in block) is not constant, and 
the image variation is interceptedly detected, when 
valid block determination is made using a single 
threshold, it is determined that all blocks are invalid 
if an image changes moderately as shown in Figure 
23B. Therefore, when the image in the serial areas is 
reconstructed, image-changed areas appear as be- 
ing intercepted by another area, thereby displaying 
an unnatural Image. 

On the other hand, with the 7th image data en- 
coding device, in the above described areas where 
images changes moderately, it is determined using a 
larger threshold that the preceding or succeeding 
block is valid. Therefore, as shown in Figure 23F, it is 
determined that the above described series of areas 
are all valid. As a result, all these areas are changed 
in image when the original image is reconstructed 
and displayed, thereby outputting a naturally recon- 
structed image. 

The above described 7th image encoding device 
is realized by hardware. However, the function can be 
realized by software such as microprocessors and 
digital signal processors. 

The function can also be realized by reducing the 
amount of encoded transmission data by encoding 
block information (change information) indicating 
whether each block in a flame is valid or invalid. 

A rate of data compression can be greatly raised 
for a series of images where a small change can be 
detected between adjacent frames by selectively en- 
coding and outputting only blocks considered to have 
been changed in Image from the preceding frame. Us- 
ing this effect, an average rate of compression of 
moving data such as TV telephones images, moving 
images, etc for which a camera is fixed can be greatly 
raised. 

When image data in a block are encoded, valid 
block determination is made flexibly by using two 
thresholds. Accordingly, the reconstruction of an un- . 
natural image can be prevented by determining a ser- 
ies of areas from the start to the end of a change to 
be valid block areas even when a change in image is 
made moderately. 

Figure 30 is the block diagram indicating the con- 
figurations of the 8th and 9th image data encoding 
devices according to the present invention. Each of 
the devices relates to an image data encoding device 
for encoding a series of image data, and comprises 
the following units. 

A reference frame storing unft 11 stores image 
data in a reference frame. 

A present frame storing unit 12 stores image data 
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in the present frame (the latest frame whose data are 
to be encoded). 

A determination threshold storing unit 13 stores 
a threshold used in determining the existence of a 
change in image in each block of the present frame 5 
located at the position corresponding to that in the 
reference frame. 

A block change determining unit 14 obtains the 
variation of picture element value of a block located at 
a position corresponding to that of the reference 10 
frame stored in the reference frame storing unit 11, 
compares the variation with the threshold stored in 
the determination threshold storing unit 13, and de- 
termines the change in image in each of al) blocks in 
the present frame from the image in the block located 15 
at the position corresponding to that in the reference 
frame. 

A block information storing unit 15 stores deter- 
mination results of all blocks in the present frames ob- 
tained by the block change determination unit 14 as 20 
block information. 

An encoding unit 16 encodes data in a valid block 
which is determined to be an image-changed block 
compared with the corresponding block in the refer- 
ence frame if the present frame is not a refresh frame, 25 
and encodes data after dividing all blocks in the pres- 
ent frame into valid blocks and invalid blocks which 
are determined to be image-unchanged blocks com- 
pared with the reference frame if the present frame is 
a refresh frame according to t he block i nfor mation on so 
each block in the present frame stored in the block in- 
formation storing unit 15. 

The reference frame storing unit 1 1 updates in the 
reference frame the image data in the block, located 
at the position corresponding to that of the block 35 
whose data are encoded by the encoding unit 16 in 
the present frame, to the encoded image data in the 
block in the present frame. 

The 9th image data encoding device according to 
the present invention furt her comprises, in addition to 40 
the units 11, 12, 13, 14, 15, and 16, a refresh signal 
generating unit 19 for outputting a refresh signal indi- 
cating that the present frame is a refresh frame to at 
least the encoding unit and the reference frame stor- 
ing unit 11 each time the number of frames data- 45 
encoded by the encoding unit 16 reaches a predeter- 
mined value. 

In the 8th and 9th image data encoding device, 
if the present frame is a refresh frame, then the en- 
coding unit 16 divides the present frame into valid 50 
blocks and invalid blocks to encode data in two steps. 
Therefore, the encoding unit 16 first encodes al) valid 
blocks, and then ail invalid blocks. 

Thus, since data in refresh frames are encoded in 
plural times of encoding processes, image encoded 66 
data in refresh frames having a large amount of codes 
can be transmitted and reconstructed in plural steps. 
Therefore, a reconstructing equipment can start its 



reconstructing process at time Intervals at which 
framed data are normally reconstructed, and reduce 
t he capacity of a code buffer at both encoding and re- 
constructing equipments. 

When data in a refresh frame are encoded, those 
in valid blocks are encoded first because they have 
a larger influence on the quality of a reconstructed 
image. After the data in all valid blocks have been en- 
coded, data in invalid blocks are encoded. 

Thus, in a reconstructing equipment, data in a re- 
fresh frame can be reconstructed more naturally than 
in a conventional method and the capacity of a buffo- 
can be reduced in both encoding and reconstructing 
equipments although the refresh frame has a large 
amount of codes. 

Figure 31 is the block diagram showing the con- 
figuration of the 10th image data encoding device. 
The device refers to an image data encoding device 
for encoding a series of image data, and comprises 
the following units. 

A reference frame storing unit 21 stores image 
data in a reference frame. 

A present frame storing unit 22 stores image data 
in the present frame (the latest frame whose data are 
to be encoded). 

A determination threshold storing unit 23 stores 
a threshold used in determining the existence of a 
change in image in each block of the present frame 
located at the position corresponding to that in the 
reference frame. 

A block change determining unit 24 obtains the 
variation of picture element value of a block located 
at a position corresponding to that of the reference 
frame stored in the reference frame storing unit 21, 
compares the variation with the threshold stored in 
the determination threshold storing unit 23, and de- 
termines the change in image in each of all blocks in 
the present frame from the image in the block located 
at the position corresponding to that in the reference 
frame. 

A block information storing unit 25 stores deter- 
mination results of all blocks in the present frames ob- 
tained by the block change determination unit 24 as 
block information. 

An encoding unit 26 encodes data in a valid block 
which is determined to be an image-changed block 
compared with the corresponding block in the refer- 
ence frame if the present frame is not a refresh frame, 
and encodes data after dividing all blocks In the pres- 
ent frame into valid blocks and invalid blocks which 
are determined to be image-unchanged blocks com- 
pared with the reference frame if the present frame is 
a refresh frame according to the block information on 
each block in the present frame stored in the block in- 
formation storing unit 25. 

A frame switching unit 27 switches the present 
reference frame storing unit 21 to the present frame 
storing unit 22, and the present frame storing unit 22 
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to the reference frame storing unit 21 when the pres- 
ent frame whose data are encoded by the encoding 
unit 26 is a refresh frame. 

The reference frame storing unit 21 updates in 
the reference frame the image data in the block, lo- 
cated at the position corresponding to that of the 
block whose data are encoded by the encoding unit 
26 in the present frame, to the encoded image data 
in the block in the present frame if the present frame 
is not a refresh frame. 

With the encoding device, the frame switching 
unit 27 switches the present reference frame storing 
unit 21 to the present frame storing unit 22, and the 
present frame storing unit 22 to the reference frame 
storing unit 21 when the present frame whose data 
are encoded by the encoding unit 26 is a refresh 
frame. Therefore, in a refreshing process, data in a 
reference frame can be updated at a higher speed 
than in a conventional method. 

Figure 32 is the block diagram showing the con- 
figuration of the 11th image data encoding device. 
The device refers to an image data encoding device 
for encoding a series of image data, and comprises 
the following units. 

A reference frame storing unit 31 stores image 
data in a reference frame. 

A present frame storing unit 32 stores image data 
in the present frame (the latest frame whose data are 
to be encoded). 

A determination threshold storing unit 33 stores 
a threshold used in determining the existence of a 
change in image in each block of the present frame 
located at the position corresponding to that in the 
reference frame. 

A block change determining unit 34 obtains the 
variation of picture element value of a block located at 
a position corresponding to that of the reference 
frame stored in the reference frame storing unit 31, 
compares the variation with the threshold stored in 
the determination threshold storing unit 33, and de- 
termines the change in image in each of all blocks in 
the present frame from the image in the block located 
at the position corresponding to that in the reference 
frame. 

An encoding unit 35 encodes data In the valid 
blocks whose data have been determined to have 
changed from data in the reference fame by the block 
change determination unit 34. 

A determination threshold setting unit 36 deter- 
mines whether or not a threshold presently stored in 
the determination threshold storing unit 33 is an ap- 
propriate value according to the amount of codes of 
data encoded by the encoding unit 35. If not, the unit 
sets the determination threshold storing unit 33 to a 
value different from the threshold. 

If the determination threshold reassigning unit 36 
determines that the threshold presently stored in the 
determination threshold storing unit 33 is an appropri- 



ate value, then an encoded data output unit 37 out- 
puts data encoded by the encoding unit 35. 

Figure 33 is the block diagram showing the con- 
figuration of the 12th image data encoding device. 
The device refers to an image data encoding device 
for encoding a series of image data, and comprises 
the following units. 

A reference frame storing unit 41 stores image 
data in a reference frame. 

A present frame storing unit 42 stores image data 
in the present frame (the latest frame whose data are 
to be encoded). 

A determination threshold storing unit 43 stores 
a threshold used in determining the existence of a 
change in image in each block of the present frame 
located at the position corresponding to that in the 
reference frame. 

A block change determining unit 44 obtains the 
variation of picture element value of a block located 
at a position corresponding to that of the reference 
frame stored in the reference frame storing unit 41, 
compares the variation with the threshold stored in 
the determination threshold storing unit 43, and de- 
termines the change in image in each of all blocks in 
the present frame from the image in the block located 
at the position corresponding to that in the reference 
frame. 

A determination threshold reassigning unit 45 
counts the number of valid blocks which are deter- 
mined to have changes in image from a reference 
frame, or the number of invalid blocks which are de- 
termined to have no changes in image from the ref- 
erence frame. Then the unit determines whether or 
not the threshold stored in the determination thresh- 
old storing unit 43 is an appropriate value according 
to the number of the valid blocks or the invalid blocks. 
If no, the unit sets the determination t hreshoJd storing 
unit 43 to a value different from the threshold. 
An encoding unit 46 encodes data in the blocks 
40 in the present frame stored in t he present frame stor- 
ing unit 42 and determined to be valid by the deter- 
mination threshold storing unit 43 if the determination 
threshold reassigning unit 45 determines that the 
threshold stored in the determination threshold stor- 
45 tng unit 43 Is an appropriate value. 

According to the 11th and 12th image data en- 
coding devices, each of the determination threshold 
reassigning units 36 and 45 determines whether or 
not a threshold presently stored in the determination 
so threshold storing units 33 and 43 is an appropriate 
value according to the amount of data encoded by the 
encoding unit 35 (in the invention according to Claim 
12) or according to the number of blocks determined 
to be valid or invalid by the block change determining 
55 unit 44 (in the invention according to the Claim 13). If 
no, the units repeatedly perform a process of reas- 
signing another value to the determination threshold 
storing units 33 and 43 unta it is determined that the 
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threshold is an appropriate value. When the units de- 
termine that the threshold is an appropriate value, 
they output encoded data of images in the present 
frame. 

Therefore, image data in each frame can be en- 
coded to refer to an appropriate amount of codes ac- 
cording to the characteristics of images and a trans- 
mission rate of a transmission line. 

Figure 34 is the block diagram showing the con- 
figuration of the 13th image data encoding device. 
The device refers to an image data encoding device 
for encoding a series of image data, and comprises 
the following units. 

A reference frame storing unit 51 stores image 
data in a reference frame. 

A present frame storing unit 52 stores image data 
in the present frame (the latest frame whose data are 
to be encoded). 

A histogram generating unit 53 obtains the varia- 
tion of a predetermined picture element value used as 
a scale in detecting an image change in each block in 
the present frame against the block located at a pos- 
ition corresponding to the image-changed block ac- 
cording to the image data in the reference frame stor- 
ed in the reference frame storing unit 51 and the im- 
age data in the present frame stored in the present 
frame storing unit 52, thereby generating a histogram 
for the variation in the entire present frame. 

A determination threshold setting unit 54 sets a 
determination threshold used to determine the exis- 
tence of a change in image in each block in the pres- 
ent frame against the block, located at a position cor- 
responding to the image-changed block in the pres- 
ent block, in the reference frame according to the his- 
togram generated by the histogram generating unit 
53. 

A block change determining unit 55 compares the 
variation of the predetermined picture element value 
in each block of the present frame generated by the 
histogram generating unit 53 with a determination 
threshold set by the determination threshold setting 
unit 54 so as to determine the existence of a changed 
image in all blocks in the present frame against the 
blocks, located at a position corresponding to an im- 
age-changed block in the present frame, in the refer- 
ence frame. 

An encoding unit 56 encodes data only in valid 
blocks determined by the block change determining 
unit 55 to have changed images in all blocks in the 
present frame. 

The histogram generating unit 53 can also be de- 
signed to obtain the absolute value of the difference 
in a predetermined picture element value between 
picture elements in the present frame and the refer- 
ence frame at the corresponding position in the cor- 
responding block, obtain the maximum absolute val- 
ue of the difference in each block in the present frame 
as the variation in a predetermined block, and to gen- 



erate a histogram based on the variation. 

According to the 13th image data encoding de- 
vice, the histogram generating unit 53 obtains the va- 
riation of a predetermined picture element value used 
5 as a scale in detecting an image change In each block 
in the present frame against the block located at a 
position corresponding to the image-changed block 
according to the image data in the reference frame 
stored in the reference frame storing unit 51 and the 
10 image data in the present frame stored in the present 
frame storing unit 52, thereby generating a histogram 
for the variation in the entire present frame. 

The determination threshold setting unit 54 sets 
a determination threshold used to determine the ex- 
1 5 istence of a change in image in each block in the pres- 
ent frame against the block, located at a position cor- 
responding to the image-changed block in the pres- 
ent block, in the reference frame according to the his- 
togram generated by the histogram generating unit 
20 53. The block change determining unit 55 compares 
the variation of the predetermined picture element 
value in each block of the present frame generated by 
the histogram generating unit 53 with a determination 
threshold set by the determination threshold setting 
25 unit 54 so as to determine the existence of a changed 
image in all blocks in the present frame against the 
blocks, located at a position corresponding to an im- 
age-changed block in the present frame, In the refer- 
ence frame. The encoding unit 56 encodes data only 
30 in valid blocks determined by the block change deter- 
mining unit 55 to have changed images in all blocks 
in the present frame. 

Therefore, since a threshold can be set such that 
the number of valid blocks refers to a constant value 
35 based on the above described histogram, the opti- 
mum encoding process in which an appropriate 
amount of codes can be obtained for each frame de- 
pending on various conditions such as the informa- 
tion transmission speed of a transmission line, the 
40 number of transmitted frames, etc. can be performed. 
Figure 35 is the block diagram showing the con- 
figuration of the 14th image data encoding device. 
The device refers to an image data encoding device 
for encoding a series of image data, and comprises 
45 the following units. 

A reference frame storing unit 61 stores image 
data in a reference frame. 

An area dividing unit 62 divides image data in the 
present frame into a plurality of areas, 
so A determination threshold output unit 63 outputs 
individually a threshold used to detect the existence 
of a change in image in a plurality of blocks in each 
area habited by the area dividing unit 62 in the pres- 
ent frame against the block atthe corresponding pos- 
se ition in the reference frame. 

A block change determining unit 64 obtains the 
variation of a predetermined picture element value fee 
each block in each area obtained by the area dividing 
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unit 62 in the present frame against the correspond- 
ing block in the reference frame stored in the refer- 
ence frame storing unit 61, compares the variation 
with the threshold applied by the determination 
threshold output unit 63, and determines whether or 
not a change in image is detected between blocks in 
each area in the present frame and the correspond- 
ing blocks in the reference frame. . 

An encoding unit 65 encodes only valid blocks de- 
termined by the block change determining unit 64 to 
have changed images against the reference frame. 

A block information output unit 66 outputs the de- 
termination result of the block change determining 
unit 64 as block information. 

A reference frame storing unit 61 replaces a block 
in the reference frame located at the position corre- 
sponding to that of a valid block in the reference frame 
with the valid block. 

Figure 36 is the block diagram indicating an as- 
pect of the determination threshold output unit 63. 

In Figure 36, a threshold storing unit 63a is a 
memory for storing a plurality of thresholds. 

A control unit 63b switches at predetermined in- 
tervals a threshold outputted by the threshold storing 
unit 63a to the block change determining unit 64 for 
each area in the present frame. 

Figure 37 is the block diagram indicating another 
aspect of the above described determination thresh- 
old output unit 63. 

In Figure 37, a threshold storing unit 63d is a 
memory for storing a plurality of thresholds for a plur- 
ality of areas in the present frame. 

A control unit 63e outputs a threshold for each 
area in the present frame from the threshold storing 
unit 63d. 

A threshold transforming unit 63f outputs a 
threshold for each area in the present frame from the 
threshold storing unit 63d to the block change deter- 
mining unit 64 after modifying the threshold at a pre- 
determined frame interval. The threshold modifying 
process is performed by, for example, an arithmetic 
operation. 

According to the 14th image data encoding de- 
vice, the area dividing unit 62 divides the image data 
in the present frame to a plurality of areas. Then, the 
block change determining unit 64 determines the 
change in image against the data in the correspond- 
ing block in the reference frame using a threshold for 
each area inputted by the determination threshold 
output unit 63 for each block in each area. According 
to the above described determination result, the en- 
coding unit 65 encodes only valid blocks determined 
to have an image changed against the data in the ref- 
erence frame. The block information output unit 66 
outputs the above described determination result as 
block information. Furthermore, the reference frame 
storing unit 61 replaces a block in the reference frame 
with the valid block located at the corresponding pos- 



ition in the present frame. 

Therefore, the determination threshold output 
unit 63 refreshes image data in each area in the ref- 
erence frame and solves the image deterioration 
5 problem due to the above described error by modify- 
ing the threshold outputted for each area in the pres- 
ent frame at predetermined frame intervals. In the re- 
freshing process, since only valid blocks are encoded, 
the increment of the amount of codes can be mini- 
w mized. 

Furthermore, a process of reducing an error in 
each area in the reference frame against the original 
image can be performed after dividing a frame into a 
plurality of frames and performed on them in a pro- 
fs determined order. Thus, the error can be gradually re- 
duced. That is, the entire areas are not simultaneous- 
ly refreshed as in the conventional method, but the 
refreshing process can be performed in area units 
over a plurality of frames. Therefore, an unnatural im- 
20 age in which the image flashes during the refreshing 
process can be prevented. 

That is, according to the determination threshold 
output unit 63 with the configuration shown in Figure 
36, the control unit 63b controls the correlation be- 
25 tween a plurality of thresholds stored by the thresh- 
old storing unit 63 and each area in the present frame 
such that the correlation is changed at predeter- 
mined frame intervals. Therefore, a threshold output- 
ted for each area in the present frame can be modified 
30 at predetermined frame intervals. For example, ac- 
cording to the determination threshold output unit 63 
with the configuration shown in Figure 37, the control 
unit 63e outputs a predetermined threshold to each 
area in the present frame from the threshold storing : 
35 unit 63d, and the threshold transforming unit 63f out- 
puts to the block change determining unit 64 a thresh- 
old outputted corresponding to each area after mod- 
ifying it at predetermined frame intervals. Thus, a 
threshold outputted corresponding to each area in 
40 the present frame can be modified at predetermined 
frame intervals, thereby successfully obtaining the 
above described effect 

Figure 38 is the flowchart indicating the 6th im- 
age data encoding method as an embodiment of the 
45 present invention. 

According to this encoding method, as shown in 
Figure 38, a picture element in the first block in a 
frame applied to and stored in an image buffer (here- 
inafter referred to as a present frame) is compared 
50 with that in the corresponding block in the reference 
frame so that the first block in the present frame is a 
valid block having a change in image against the 
present frame (S1 01 ). 

A valid block determination can be made through 
55 each of the following methods (1), (2), and (3), etc 
(1) The sum of absolute values of differences be- 
tween picture elements (gradation values, for ex- 
ample) in each block in the present frame and 
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those in the corresponding block in the reference 
frame is obtained, and a block having a total value 
larger than a predetermined threshold is consid- 
ered to be a valid or block. According to this meth- 
od, a determination is made based on a total val- 5 
ue. Thus, a change in an entire block can be 
checked. 

(2) The above described absolute value of differ- 
ence is obtained for each block in the present 
frame. If the maximum value in these absolute to 
values of differences is larger than a predeter- 
mined threshold, the block is considered to be 
valid. Since only an absolute value of a difference 
must be detected in this method, the detecting 
process can be performed at a high speed with 15 
a relatively simple circuit 

(3) The sum of square numbers of differences be- 
tween picture elements (gradation values, for ex- 
ample) in each block in the present frame and the 
corresponding block in the reference frame is ob- 20 
tained. If the sum is larger than a predetermined 
threshold, the block is considered to be valid. 
Since a block is determined according to the sum 

of square numbers of differences in picture ele- 
ments in this method, the variation is empha- 25 
sized. Therefore, a change in one block can be 
visually checked exactly. 
If the first block is a valid block, change informa- 
tion indicating a valid block is written to a correspond- 
ing position in the block information storing unit ("I" 30 
for example) (S102). 

Then, the image data in the first block are encod- 
ed through the ADCT, etc. (S103), and the data in the 
first block in the reference frame are updated to the 
contents of the first block in the present frame (S104). 35 

If it is determined that the first block in the pres- 
ent frame is invalid, that is, has no change in image 
in the determining process in step S1, change infor- 
mation indicating an invalid block ("0", for example) is 
written in the corresponding position in the block in- 40 
formation storing unit ($105). 

Then, the processes in steps S1 - S5 are repeat- 
ed on afl blocks in and after the 2nd block in the pres- 
ent frame, change information indicating a valid block 
or an invalid block is written in the block information 45 
storing unit for all blocks in the present frame, and the 
data in the reference frame are updated by rewriting 
the data in the blocks to the data in the corresponding 
block in the present frame if the corresponding blocks 
in the present frame are determined to be valid. 50 

If it rs determined that the processes in steps 
S101 through S105 have been performed for all 
blocks in the present frame ("Yes* in S106), then it is 
determined whether or not the present frame is a re- 
fresh frame (S107). If yes, the change information for 55 
all blocks in the present frame stored in the block in- 
formation storing unit is sequentially read from the 
first block (S1 08), and it is determined whether or not 



each block is valid or invalid (S109). Then, the data 
in invalid blocks only are encoded as in the above de- 
scribed valid blocks (S110), and then the reference 
frame is updated by rewriting the data In the blocks 
to the contents of the blocks in the present frame if 
the corresponding blocks in the present frame are In- 
valid (S111). 

If it is determined that the processes in steps 
S109 through S111 have been performed CYes" In 
S11 2), then the image data encoding process is com- 
pleted for the present frame. 

Thus, first in the encoding method, image data in 
valid blocks are encoded, and then frnage data in in- 
valid blocks are encoded if the present frame is a re- 
fresh frame. If blocks are encoded, the corresponding 
blocks in the reference frame are replaced with the 
encoded blocks in the present frame. 

Therefore, in a normal frame other than a refresh 
frame, data in a valid block are encoded. Only when 
a frame is a refresh frame, all blocks are encoded in 
the order of valid blocks and invalid blocks. 

Figure 39 shows the operation in time series of 
encoding data in a frame in a sending equipment and 
reconstructing an original image from transmitted en- 
coded data in a receiving equipment when the moving 
image have been encoded in frame units by the above 
described image data encoding method and transmit- 
ted to the receiving equipment where the original Im- 
age is reconstructed from the encoded data. Figure 
39 indicates the difference in a process of recon- 
structing an original image in a refresh frame in a re- 
constructing equipment between the conventional 
image data encoding method shown in Figure 5 and 
the image data encoding method according to the 6th 
image data encoding method. 

As shown in Figure 5, when images are recon- 
structed by the conventional encoding method, an 
encoding time interval is not synchronized with recon- 
struction time intervals and the reconstruction of the 
3rd frame is performed at time T 4 , not at time T a , If t he 
codes in a refresh frame (the 3rd frame, start-of- 
encoding time ts) are not transmitted by the start-cf- 
encoding time V Thus, the reconstruction results in 
an unnatural image displayed on the receiving equip- 
ment On the other hand, since an image In a refresh 
. frame (the 3rd frame) is reconstructed from encoded 
data only in valid blocks at time T 8 in a method accord- 
ing to the present embodiment, the above described 
synchronization between an encoding time interval 
and a reconstruction tome interval can be prevented, 
and the reconstructed image is not displayed unnat- 
urally on the receiving equipment Then, since an im- 
age in a refresh frame (the 3rd frame) is reconstruct- 
ed completely from encoded data with invalid blocks 
included at the reconstruction time T 4 and the Image 
in the refresh frame (the 3rd frame) is reconstructed 
from encoded data in valid blocks at the reconstruc- 
tion time T* an operator feels that the receiving 
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equipment is assigned the shortest possible wait time 
when the image in the refresh frame is reconstructed. 

Furthermore, since a refresh frame containing a 
large amount of codes is encoded after being divided 
into valid blocks and invalid blocks, and the encoded 5 
data In valid blocks are transmitted prior to those in in- 
valid blocks, the capacity of a code buffer both in the 
sending and receiving equipment can be reduced 
than the conventional method. 

Figure 40 is the block diagram indicating the cir- 10 
curt configuration of the 15th image data encoding 
device for encoding image data according to the 6th 
image data encoding method. 

An image buffer 1020 stores image data in one 
frame (present frame) applied through an input term*- is 
nal 1010, and outputs the data in block (8x8 picture 
elements, for example) units in a predetermined order 
to a block change determining unit 1040 and an en- 
coding unit 1060. 

A reference frame storing unit 1 030 is a memory 20 
for storing image data in a reference frame which are 
compared with the image data in the present frame 
stored in the image buffer 1020. The contents of the 
reference frame storing unit 1030 are sequentially re- 
written according to block information in each block in 25 
the latest frame (present frame) applied from a block 
information storing unit 1050, and are used as image 
data in the reference frame. 

The block change determining unit 1040 com- 
pares the image data in each block transmitted from 30 
the image buffer 1020 with the data in the corre- 
sponding block in the reference frame stored in the 
reference frame storing unit 1030, obtains (1) the sum 
of absolute values of the differences in picture ele- 
ment values, (2) the maximum absolute value of dff- 35 
ferences in image or picture element values, or (3) the 
sum of average square numbers of differences in im- 
age or picture element values, compares one of the 
values with a threshold stored in a determination 
threshold storing unit 1070, and determines whether 40 
each block in the present frame is valid (the above de- 
scribed value is equal to or larger than the threshold) 
or invalid (the above described value is smaller than 
the threshold). 

The block information storing unit 1050 stores 45 
block information (indicating that the present block is 
valid or invalid) of each block in the present frame 
written by the block change determining unit 1040, 
and the block information Is outputted to an encoding 
u nit 1 080, the reference frame storing unit 1 030, and so 
an output terminal 1090. 

The reference frame storing unit 1030 receives 
from the image buffer 1020 a valid block having the 
block information indicating a valid block, and replac- 
es the corresponding block in the reference frame 55 
with the valid block. 

The encoding unit 1060 refers to the block infor- 
mation of each block stored in the block information 



storing unit 1050 when the data of each block of im- 
age data in the present frame are sent from the image 
buffer 1020 in a predetermined order. If a refresh sig- 
nal r described later is not received, data in the blocks 
indicated as "valid" by the block information are en- 
coded to variable-length data, and the encoded data 
are outputted from the output terminal 1070. 

A refresh signal r indicates that the present frame 
stored in the present image buffer 1020 is a refresh 
frame, and is applied externally from a control unit not 
shown in Figure 40 through an input terminal 1080. 
The refresh signal r is applied to the image buffer 
1020, the block information storing unit 1050, and the 
encoding unit 1060. 

On receiving the refresh signal r, the image buffer 
1020 repeats two times the operation of outputting im- 
age data in all blocks in the present frame to the en- 
coding unit 1060 sequentially from the first block. The 
block information storing unit 1050 also repeats two 
times the operation of outputting image data in ail 
blocks in the present frame to the encoding unit 1060 
sequentially from the first block synchronously with 
the above described operation. 

On receiving a refresh signal r, the encoding unit 
1060 first encodes only the blocks identified as valid 
blocks according to the block information, and 
ond encodes the block identified as invalid blocks 
cording to the block Information. Therefore, the en- 
coding unit 1060 divides a refresh frame into valid 
block data and invalid block data, and encodes and 
outputs them in this order. 

Figure 41 is the block diagram indicating the cir- 
cuit configuration of the 16th image data encoding 
device for encoding image data according to the en- 
coding method indicated in the flowchart shown in 
Figure 38. 

In Figure 41, a circuit block also shown in Figure 
40 as a function of the image data encoding device is 
assigned the same name and number with the (to- 
taled explanation omitted here. 

The 15th image data encoding device shown in 
Figure 40 is externally provided with a refresh signal 
r, while the 16th image data encoding device shown 
in Figure 41 is internally provided with a counter 1024 
for generating a refresh signal at predetermined 
frame interval. 

The counter is an up-counter for counting the 
number of frames at predetermined time intervals, for 
example, and outputs a refresh signal r to the image 
buffer 1022, the block information storing unit 1050, 
and the encoding unit 1060 when a counter value has 
reached a predetermined value, that is, at predeter- 
mined frame intervals, 

On receiving a refresh signal r, the image buffer 
1022, the block information storing unit 1050, and the 
encoding unit 1060 encode image data in the present 
frame as described above in the order of valid blocks 
first and then invalid blocks. 
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The image buffer 1022 stores image data in one 
frame which are applied through the input terminal 
1 010, and outputs a reset signal R to the counter 1 024 
at a predetermined timing (for example, after the 
process of encoding the image in the refresh frame 5 
has been performed) when it receives a refresh signal 
r from the counter 1024. 

The counter 1024 is reset to a predetermined ini- 
tial value (0, for example) on receiving a reset signal 
R. 10 

Figure 42 shows an example of a configuration of 
the encoding unit 1060. The encoding unit 1060 
shown in Figure 42 comprises a two-dimensional 
DCT unit 1061, a linear quantizing unit 1062, a quan- 
tization matrix (quantization threshold) 1 063, and an 15 
encoding table 1065. Trie configuration of the unit is 
similar to that of the conventional static image encod- 
ing device shown in Figure 1. That is, it is different 
from the conventional device in that it does not con- 
tain the block buffer 120. The encoding table 1065 is 
used so that the variable-length encoding unit 1064 
can efficiently encode the combination of a run 
length and a quantized coefficient outputted in block 
units from the linear quantizing unit 1062. For exam- 
ple, it is a table used in an entropy encoding method 
such as a Huffman code table, arithmetic operation 
code table, etc. 

Thus, according to the present embodiment, a re- 
fresh frame is divided into valid blocks and invalid 
blocks, and the data in the valid blocks are first en- 
coded and transmitted, and then the data in the inval- 
id blocks are encoded and transmitted. Therefore, a 
reconstructing equipment (a receiving equipment) 
can reconstruct original images from refresh frames 
through a sort of hierarchical reconstruction. There- 
fore, an operator for the reconstructing equipment 
feels that his or her wait time is not very long in suc- 
cessfully reconstructing an original image. 

Thus, the capacity of the code buffer for tempor- 
arily storing encoded data of images in frames both in 
encoding reconstructing equipments by encoding the 
data in refresh frames after dividing them into two 
block groups. 

When images are refreshed, that is, when data in 
a refresh frame are encoded, a reference image stor- 
ed in the reference frame 1030 should be replaced 
with the data in the refresh frame. In this case, the Im- 
age data in all blocks in one frame stored in the ref- 
erence frame 1030 should be updated to the above 
described image data in the refresh frame. 

The following embodiment updates at a high 
speed the reference frame when the refreshing proc- 
ess is performed. 

Figure 43 is the flowchart indicating the 7th im- 
age data encoding method. 

A function also shown in Figure 38 as that of the 
6th image data encoding method is assigned the 
same symbol (step number). 



In this embodiment, it is first determined as in the 
above described 6th image data encoding method 
whether blocks in the present frame are valid or inval- 
id, and change information (block information) indi- 
cating whether blocks are valid or invalid is stored 
(S101 - S103, S105 and S106). That Is, up to this 
point, the data in the reference frame have not been 
updated. 

Next, it is determined whether or not the present 
frame is a refresh frame (S107). If no ("No" in S107), 
valid blocks in the present frame replace the corre- 
sponding blocks in the reference frame according to 
the change information stored as described above, 
thereby updating the reference frame (S1 21). 

If it is determined that the present frame is a re- 
fresh frame in step S1 07 ("Yes" n S107), then it is de- 
termined whether the blocks are valid or invalid ac- 
cording to the stored change information (S109), and 
the data in the invalid block are encoded (S110). 

When the process has been performed on all 
blocks ("Yes" in S112), then the frame memory for 
storing image data in the reference frame (reference 
frame memory) is replaced with the present frame 
memory for storing image data in the present frame, 
while the present frame memory is replaced with the 
reference frame memory for storing image data in the 
reference frame (S122). 

Therefore, the image data applied next are ap- 
plied to and stored in the frame memory hitherto used 
as a reference frame memory, and compared with the 
image data in the refresh frame stored in the frame 
memory hitherto used as the present frame memory. 
That is, according to the process in step 51 22, a proc- 
ess of updating a reference frame to be performed in 
a refreshing process can be instantaneously per- 
formed without any trouble. 

Thus, in the 7th image data encoding method, 
since the functions of the reference frame memory 
and the present frame memory are switched to each 
other each time a refreshing process is performed, it 
is not necessary to rewrite the image data in all blocks 
in the reference frame to those in the present frame. 
Therefore, the reference frame memory can be up- 
dated instantaneously in a refreshing process. 

Figure 44 shows the circuit configuration of the 
1 7th image data encoding device for encoding image 
data according to the encoding method indicated in. 
the flowchart shown in Figure 43. 

In Figure 44, a circuit block also shown in Figure 
40 as a function of the 15th image data encoding de- 
vice is assigned the same name and number with the 
detailed explanation omitted here. The image data en- 
coding device shown in Figure 44 is realized by pro- 
viding the device shown in Figure 40 with a switch 
2010 for switching the reference frame storing unit 
1 030 and the image buffer (present memory) 1 020 al- 
ternately in a refreshing process. 

The switch 2010 receives a refresh signal r from 
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an external control unit through the input terminal 
1080. Each time the refresh signal r is applied, the 
switch 2010 switches the destination of image data in 
one frame (input frame) applied through t he input ter- 
minal 1010 alternately to the image buffer 1020 and 
the reference frame storing unit 1030 after the above 
described refreshing process has been performed 
(after encoding the data in all blocks in the input 
frame). As a result, each time a refresh signal r is ap- 
plied, the image buffer 1020 and the reference frame 
storing unit 1030 exchange their functions after a re- 
freshing process has been performed. 

Since the reference frame storing unit 1030 as 
being switched to an image buffer or the image buffer 
1020 stores the image data in the present frame at 
present, the above described switching operation by 
the switch 2010 can update the images in the refer- 
ence frame instantaneously in a refreshing process 
without transferring (copying) from the image buffer 
to the reference frame storing unit the data in all 
blocks in the latest frame to be stored in the reference 
frame storing unit according to a conventional meth- 
od. 

The level of the variation in moving between ad- 
jacent frames depends on the type of image. There- 
fore, if a threshold (hereinafter referred to as a deter- 
mination threshold) used for valid blocks and appro- 
priate to a mobile image is applied to a static image, 
then the value is too large for the image to be suc- 
cessfully detected as valid blocks although each of 
them affects the quality of the whole reconstructed 
image. On the other hand, if a determination thresh- 
old used to recognize static blocks as valid blocks, 
that is, appropriate to a static image, is applied to a 
mobile image, then the number of valid blocks be- 
comes too large and the total amount of codes in- 
creases greatly. 

The following embodiment has been developed 
to solve the above described problem. 

First Figure 45 is the flowchart indicating the Im- 
portant operation of the 8th image data encoding 
method according to the embodiment 

First any of (1) the sum of absolute values of the 
differences in image or picture element values, (2) the 
maximum absolute value of differences in image or 
picture element values, and (3) the sum of average 
square numbers of differences in image or picture ele- 
ment values is obtained for all block in a frame. Then, 
it is determined whether or not any of them is equal 
to or larger than a determination threshold T, all valid 
blocks having any of the above described values 
equal to or larger than the determination threshold 
are extracted, and the valid blocks are encoded 
($131). 

Then, if the amount of codes obtained by the 
above described encoding process (sum of the 
amount of codes in all valid blocks) is calculated, the 
obtained amount of codes is compared with a prede- 



termined appropriate amount of codes (S132 ), and 
the obtained amount of codes is smaller than the ap- 
propriate amount of codes ("No" in S132), then the 
above described determination threshold is reduced 
5 (S133), and control is returned to the process in step 
S131. 

If the calculated amount of codes is larger than 
the appropriate amount of codes ("Yes" in S132), then 
it is determined whether or not the difference be- 
to tween the amount values is smaller than a predeter- 
mined value (S 1 34). If it is larger ("No" in S1 34), then 
the value of the determination threshold T is raised 
(S135), and control is returned to the process in step 
S132. On the other hand, if the difference between 
15 the amount values is smaller than a predetermined 
value ("Yes" in S134), then the determination thresh- 
old T is not changed. 

Thus, the determination threshold T is changed 
until the sum of the amount of codes in valid blocks 
20 (calculated amount of codes) is equal to or larger than 
the appropriate amount of codes and the difference 
is smaller than a predetermined value. Then, the 
\ modification of the determination threshold T is stop- 
ped when the sum of the amount of codes in valid 
25 blocks has reached an appropriate value, thereby ter- 
minating a process of encoding valid blocks (method 
I). 

In the above described method, a determination 
threshold T is reset according to the amount of codes 

30 obtained in an encoding process. Since the amount 
of codes varies in proportion to the number of encod- 
ed blocks, that is, the number of valid blocks, the 
number of valid blocks can be counted without per- 
forming an encoding process, and the determination 

35 threshold T can be modif ied until the amount of codes 
becomes equal to the appropriate value according to 
. the number of valid blocks obtained by the above 
counting operation (method II). In this method II, 
since the determination threshold T can be set at a 

40 speed higher than method i, and the encoding proc- 
ess must be performed only once, the process of en- 
coding the present frame can be completed at a 
speed higher then method I. 

Furthermore, adjacent frames indicate very sim- 

46 liar images in processing moving. Therefore, a deter- 
mination threshold T can be a value used in encoding 
image data in the preceding frame, and can be modi- 
fied (set) after the encoding process, thereby speed- 
ing up the encoding process (method III). 

so In the above described three methods, the deter- 
mination threshold T is set each time the data in each 
frame are encoded. However, since the variation be- 
tween frames is almost constant in series of moving 
images (since images in a series of frames are simi- 

55 lar), the determination threshold (T) setting process 
by each of the above described methods is per- 
formed on the first n frames (n=1, 2, 3, ...). and the 
encoding process on the n-th and the following 

35 
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frames (the (rvM )th frame) is performed using the de- 
termination threshold T determined in any of the pre- 
ceding frames so that the time taken for encoding the 
data in the (n+1) and the following frames can be 
shortened. 

Figure 46 is the block diagram showing the circuit 
of the 18th image data encoding device for encoding 
image data in a frame after flexibly setting a determi- 
nation threshold T by the above described method I 
so that the amount of codes Is appropriate. 

In Figure 46, a circuit block also shown in Figure 
40 as a function of the 15th image data encoding de- 
vice is assigned the same name and number with the 
detailed explanation omitted here. 

The encoding unit 1060 sequentially reads from 
the block information storing unit 1040 the block In- 
formation in each block in the present frame in a pre- 
determined order, and encodes the data in valid 
blocks only. Then, on having encoded the data in one 
frame, the encoding unit 1060 transfers the encoded 
data in one frame to a code amount determining unit 
3010. 

The code amount determining unit 3010 determi- 
nes whether or not the transferred amount of codes 
in the present frame is appropriate. If yes, the unit 
sends a send enable signal PE to a switch 3012. 

On receiving the send enable signal PE, the 
switch 3012 externally outputs from the output termi- 
nals 1070 and 1090 respectively the encoded data in 
the present frame stored in the encoding unit 1060 
and the block information on all blocks in the present 
frame stored in the block information storing unit 
1050. 

if the code amount determining unit 1060 deter- 
mines that the amount of codes in the present frame 
does not refer to an appropriate value, it sends a de- 
termination threshold rewrite signal RE T to determi- 
nation threshold storing unit 3014, and sends a re-re- 
ad signal RR to an image buffer 3016. 

The determination threshold storing unit 3014 
modifies a determination threshold T according to the 
instruction transmitted as a determination threshold 
rewrite signal RE T (instruction to raise or reduce the 
determination threshold T). 

The block change determining unit 1040 gener- 
ates using the modified determination threshold T 
the block information as to whether each image data 
block in the present frame transmitted again from the 
image buffer 301 6 is valid or invalid, and transfers the 
block information to the block information storing unit 
1050. 

Then, the encoding unit 1060 encodes according 
to the newly obtained block information only valid 
blocks In the image data in the present frame trans- 
mitted again from the image buffer 301 6, and outputs 
the obtained encoded data of the image data in the 
present frame to the code amount determining unit 
3010. 



The code amount determining unit 3010 determi- 
nes whether or not the amount of the transmitted en- 
coded data is appropriate; 

Thus, the determination threshold storing unit 

5 3014 modifies the determination threshold T until the 
code amount determining unit 3010 determines that 
the amount of codes is appropriate. Then, the code 
amount determining unit 3010 sends a send enable 
signal PE to the switch 3012 when the amount of 

10 codes of image data in the present frame is appropri- 
ate according to the modified determination thresh- 
old T Thus, the encoded data of the image data in the 
present frame and the block information on each 
block in the present frame are externally outputted to 

15 the terminals 1070 and 1090 through the switch 
3012. 

The image data in each frame are thus encoded 
such that the amount of codes constantly is appropri- 
ate, and the encoded data and the block information 

20 on ail blocks are outputted. Therefore, even if a recon- 
structing equipment for reconstructing original im- 
ages from the encoded data receives encoded data 
relating to only valid or blocks according to the block 
information, the corresponding blocks to the valid 

25 blocks can be correctly updated. 

Figure 47 shows the configuration of the 19th im- 
age data encoding device for encoding image data in 
each frame according to the above described method 
II. 

do In Figure 47, a circuit block also shown in Figure 
40 as a function of the 15th image data encoding de- 
vice is assigned the same name and number. 

in this device, a block change determining unit 
3020 transmits block information indicating whether 

35 each block in the present frame is valid or invalid to 
a number-of-vaiid-blocks determining unit 3022 as 
well as to the block information storing unit 1050. 

The number-of-valid-biocks determining unit 
3022 counts the number of valid blocks through a 

40 built-in counter, etc., and determines whether or not 
the number of valid blocks in the present frame is ap- 
propriate. If the number of valid blocks is appropriate, 
the number-or-vai id -blocks determining unft 3022 
sends a send enable signal PE to a switch 3024 and 

45 issues an encode instruction to an encoding unit 
3029. On receiving the instruction, the encoding unit 
3029 refers to the block information stored in the 
block information storing unit 1050, and encodes im- 
age data only in the valid blocks in the present frame. 

so On receiving the signal PE after the encoding 
unit 1060 has completed its encoding process, the 
switch 3024 externally outputs from the terminals 
1070 and 1090 respectively the encoded data of im- 
age data in the valid block in the present frame stored 

55 in the encoding unit 3029, and the block information 
on each block in the present frame stored in the block 
information storing unit 1050. 

When the number-or-valid-biocks determining 
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unit 3022 determines that the number of valid blocks 
in the present frame obtained using the present de- 
termination threshold T does not refer to an appropri- 
ate value, it sends a determination threshold rewrite 
signal RE T instructing the determination threshold 5 
storing unit 3026 to rewrite the determination thresh- 
old T, and sends a re-read signal RR to an image buf- 
fer 3028. 

The determination threshold storing unit 3026 
modifies the determination threshold T according to 
the determination threshold rewrite signal RE T trans- 
mitted from the number-of-valid- blocks determining 
unit 3022 (instructing to raise or reduce the determi- 
nation threshold T). 

The block change determining unit 3020 gener- 
ates according to the modified determination thresh- 
old T block information indicating whether each block 
of image data in the present frame transmitted from 
the image buffer 3028 is valid or invalid. 

Then, the above described operation is repeated 
until the number-of-valid-blocks determining unit 
3022 determines that the number of the valid blocks 
in the present frame is appropriate. If the determina- 
tion threshold storing unit 3026 sets an appropriate 
determination threshold T to the image data in the 
present frame, and the number of the valid blocks in 
the present frame is appropriate, then the encoded 
data of the valid blocks in the present frame encoded 
by the encoding unit 1060 and the block information 
on all blocks in the present frame are externally out- 
putted from the terminals 1 070 and 1 090 respectively 
through the switch 3024. 

Thus, The image data in each frame are thus en- 
coded such that the amount of codes constantly is ap- 
propriate, and the encoded data and the block infor- 
mation on all blocks are outputted. Therefore, even if 
a reconstructing equipment for reconstructing original 
images from the encoded data receives encoded data 
relating to only valid blocks according to the block in- 
formation, the corresponding blocks to the valid 
blocks can be correctly updated. 

Figure 48 shows the configuration of the 20th im- 
age data encoding device for encoding image data in 
each frame according to the above described method 
III. 

In Figure 48, a circuit block also shown in Figure 
40 as a function of the 15th image data encoding de- 
vice is assigned the same name and number. 

A code amount determining unit 3030 determines 
whether or not the amount of image data in the pres- 
ent frame applied from the encoding unit 1060 is ap- 
propriate. If no, the unit sends a determination thresh- 
old rewrite signal RE T to the determination threshold 
storing unit 3014. 

On receiving the determination threshold rewrite 
signal RE T , the determination threshold storing unit 
3014 modifies the determination threshold T accord- 
ing to the instruction of the signal (to raise or reduce 



the determination t h reshold T). 

The determination threshold T modified by the 
determination threshold storing unit 3014 is used 
when the block change determining unit 1040 deter- 
mines whether each block of image data in the suc- 
ceeding frame is valid or invalid. 

In this device, the block change determining unit 
1040 determines whether each block in the present 
frame is valid or invalid using the determination 
threshold T set by the determination threshold stor- 
ing unit 3014 according to the result of the image data 
encoding process performed on the preceding frame. 
Then, the encoding unit 1060 encodes only the 
blocks determined to be valid according to the deter- 
mination above. 

Then, the encoded data of the image data in the 
present frame provided by the encoding unit 1060 and 
the block information on each block in the present 
frame stored in the block information storing unit 1050 
are externally outputted respectively through the ter- 
minals 1 070 and 1 090 immediately after being encod- 
ed. 

Thus, with the device, it is determined whether a 
block is valid or invalid using a determination thresh- 
old T set according to the result of the encoding proc- 
ess performed on the preceding frame regardless of 
the appropriateness of the amount of codes of encod- 
ed data in the present frame. If the amount of encod- 
ed data in the present frame obtained by the encoding 
process using the determination threshold T is not 
appropriate at all, then the determination threshold T 
modified by the determination threshold storing unit 
3014 is used in encoding the image data in the suc- 
ceeding frame. 

That is, the device can shorten the tone taken for 
modifying a determination threshold T and speed up 
an encoding operation by taking advantage of the fea- 
ture that adjacent frames indicate similar images in 
moving data. 

Figure 49 shows the configuration of the 21st im- 
age data encoding device for encoding image data in 
each frame according to the above described method 
III. 

In Figure 49, a circuit block also shown in Figure 
40 as a function of the 19th image data encoding de- 
vice for encoding image data according to the above 
described method III is assigned the same name and 
number. 

In the device, the function of a number-of-valid 
blocks determining unit 3040 is different from that of 
the number-of-valid-blocks determining unit 3022, 
and the switch 3024 provided for the device shown in 
Figure 47 is not provided in the present device. 

LBce the number-of-valid-blocks determining unit 
3022, the number-of-valid-blocks determining unit 
3040 counts the number of valid blocks in the present 
frame according to the result of the determination by 
the block change determining unit 3020, and deter mi- 
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nes whether or not the number of valid blocks is ap- 
propriate. The number-of-valid-blocks determining 
unit 3040 outputs a determination threshold rewrite 
signal RE T to the determination threshold determin- 
ing unit 3026 only when the number of valid blocks is 5 
not appropriate. 

Then, as described above, the determination 
threshold storing unit 3026 modifies the determina- 
tion threshold T according to the instruction of the de- 
termination threshold rewrite signal RE T . 10 

The modified determination threshold T is used 
when the block change determining unit 3020 deter- 
mines whether each block in the succeeding frame is 
valid or invalid. 

The block information in each block in the present 15 
frame obtained by the block change determining unit 
3020 is stored in the block information storing unit 
1 050 and outputted to the reference frame storing unit 
1030. The encoding unit 1060 sequentially reads the 
block information in each block in the present frame 20 
stored in the block information storing unit 1050, and 
encodes only valid blocks in all blocks of image data 
in the present frame stored in the image buffer 1020 
according to the block information. 

The block information in each block In the present 25 
frame stored in the block information storing unit 1 050 
and the data in the present frame encoded by the en- 
coding unit 1060 are externally outputted through the 
terminals 1070 and 1090 respectively. 

Thus, with the device, it is determined using the 30 
d eter mination t hreshold T set according to the result 
of the encoding process performed on the preceding 
frame whether or not each block in the present frame 
is valid. Only blocks determined to be valid are encod- 
ed and outputted externally together with the block in- 35 
formation on the blocks. The determination threshold 
T modified by the determination threshold storing unit 
3026 according to the number of valid blocks obtained 
in the encoding process is used in determining a valid 
block when image data in the succeeding frame are 40 
encoded. 

Thus, unlike the device shown in Figure 48, the 
device sequentially modifies the determination 
threshold T for each frame according to the number 
of valid blocks, not according to the amount of codes, 45 
to obtain the effect provided by the device shown in 
Figure 48. 

According to the image data encoding device op- 
erated by method I or II, a determination threshold T 
used in determining a valid block can be set to an ap- so 
propriate value according to the type of image, a 
transmission rate of a transmission line, etc. That is, 
when ten pieces of images must be transmitted every 
second via an ISDN (integrated service digital net- 
work) of, for example, 64Kb/s, valid block determina- 55 
lion is made using a determination threshold T and 
only blocks determined to be valid are encoded. At 
this time, if t he amount of codes in one frame exceeds 



6400 bits, the image cannot be transmitted at a rate 
of 10 pieces per second. On the other hand, if the 
amount of codes in one frame is far below 6400 bits, 
then the low quality image is transmitted. 

In this case, according to the 3rd embodiment, 
encoded data can be transmitted after the determina- 
tion threshold T has been modified (set again) until 
the amount of codes has reached a desirable value 
(6400 bits in this case). Accordingly/a desirable im- 
age transmission can be performed depending on the 
number of pieces of transmitted images per unit time. 

Next, an embodiment having the effects of the 
1 8th through 21 st image data encoding devices is ex- 
plained below. 

Figure 50 is the flowchart explaining the 9th im- 
age data encoding method according to the above 
described embodiment 

According to the encoding method, a process of 
obtaining a predetermined variation in image or pic- 
ture element value (for example, (1) a sum of absolute 
values of differences, (2) the maximum absolute val- 
ue of difference, or (3) sum of square numbers of dif- 
ferences, etc.) between corresponding blocks in the 
present frame and the reference frame is performed 
on all blocks (S141). Then.the number of blocks is 
calculated for the variation in image or picture ele- 
ment value to obtain a histogram of the variation in im- 
age or picture element value (S142). 

Then, according to the obtained histogram, a de^ 
termination threshold T is determined to detect valid 
blocks (S143). The determination threshold T is 
based on the reference value of 10% of the number 
of blocks in one frame, with the number of blocks in- 
tegrated sequentially from the largest variation in im- 
age or picture element value until the result has 
reached the reference value or the approximation of 
the reference value. Then, the minimum value of the 
variation in image or picture element value Is set as 
the determination threshold T. 

Then, the variation in image or picture element 
value is compared with the determination threshold 
T for all blocks in the present frame, and it is deter- 
mined that a block in which the variation in image or 
picture element value Is equal to or larger than the de- 
termination threshold T is determined to be an image- 
changed block compared with the corresponding 
block in the reference frame. An image-changed 
block, that is, a valid block, is encoded (S144 through 

5146) . 

The processes in steps S141 through S146 are 
performed on all the other frames, when it is deter- 
mined that the encoding process has been per- 
formed on all valid blocks in all frames ("Yes" in 

5147) , then the encoding process terminates. 
Figure 51 is t he block diagram showing the circuit 

configuration of the 22nd image data encoding device 
for encoding image data in each frame according to 
the 9th image data encoding method. 
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In Figure 51. each of the Image buffer 1020, the 
reference frame storing unit 1030, the block change 
determining unit 1040, the block information storing 
unit 1050, and the encoding unit 1060 has the func- 
tion identical to that of the circuit block assigned the 
same name and number used in the above described 
image data encoding devices. 

A frequency calculating unit 4010 obtains the va- 
riation in image or picture element value (for example, 
the maximum absolute value of difference) between 
each block in the present frame stored in the image 
buffer 1020 and the corresponding block in the refer- 
ence frame stored in the reference frame storing unit 
1030, and then the frequency (the number of blocks) 
is calculated for each value of the variation in image 
or picture element value. That is, a histogram of the 
variation in image or picture element value is obtained 
with the frequency represented by the number of 
blocks. Then, on generating the histogram, the fre- 
quency calculating unit 4010 outputs a determination 
threshold rewrite signal RE T to a determination 
threshold setting unit 4012 

The determination threshold setting unit 4012 se- 
quentially enters the frequency (the number of 
blocks) of variation in image or picture element from 
the frequency calculating unit 4010 in the order from 
the largest variation in image or picture element val- 
ue, and then sequentially integrates the frequency 
(the number of blocks). When the integrated value 
has reached a predetermined level (for example, ap- 
proximately 10% of all blocks in one frame), the de- 
termination threshold setting unit 4012 sets the de- 
termination threshold T to the value of the variation 
in image or picture element obtained as integrated fre- 
quency (the number of blocks) in the last step of the 
calculating process, that is, the value of the minimum 
variation in image or picture element as integrated fre- 
quency (the number of blocks). 

If the determination threshold T is thus set, the 
block change determining unit 1040 receives the im- 
age data in the present frame and the reference frame 
respectively from the image buffer 1020 and the ref- 
erence frame storing unft 1030, and determines using 
the determination threshold T whether each of the 
blocks in the present frame is valid of invalid. The val- 
id/invalid determination can be performed by obtain- 
ing again the variation in image or picture element val- 
ue for each block in the present frame, and comparing 
the resultant value with the determination threshold 
T. As a result, the block change determining unit 1 040 
outputs to the block information storing unit 1050 the 
block information indicating that each of the blocks in 
the present frame is valid or invalid (for example, T 
for a valid block and "0" for an invalid block). 

The encoding unit 1060 sequentially reads in a 
predetermined order from the block information stor- 
ing unit 1050 the block information about each block 
in the present frame stored in the image buffer 1020, 



and then encodes only the data in valid blocks. When 
the encoding unit 1060 has encoded the data in all 
valid blocks in the present frame, the encoding unit 
1060 outputs through the terminal 1070 the encoded 
data obtained by the above described encoding proc- 
ess, and the block information storing unit 1050 out- 
puts through the terminal 1090 the block information 
about each block in the present frame. 

Figure 52 is the block diagram showing the con- 
figuration of the 23th image data encoding device for, 
as in the 22th image data encoding device, encoding 
image data according to the method indicated by the 
flowchart shown in Figure 50. 

In Figure 52, each of the image buffer 1020, the 
reference frame storing unit 1030, and the encoding 
unit 1060 has the function identical to that of the cir- 
cuit block assigned the same name and number used 
in the above described 15th image data encoding de- 
vices shown in Figure 39. 

A image or picture element change calculating 
unit 4020 receives the image data in the present 
frame and the reference frame respectively from the 
image buffer 1020 and the reference frame storing 
unit 1030, and, like the frequency calculating unit 
4010 of the image data encoding unit shown in Figure 
22, obtains the variation in image or picture element 
value (for example, the maximum absolute value of 
difference) for each block in the present frame, and 
the results are temporarily stored in the block infor- 
mation storing unit 4022. 

On receiving and storing the variation in image or 
picture element value for each of the blocks in the 
present frame from the image or picture element 
change detecting unit 4020. the block information 
35 storing unit 4022 outputs a determination threshold 
rewrite signal RE T to a determination threshold set- 
ting unit 4024. 

The determination threshold setting unit 4024 
reads from the block information storing unft 4022 the 
40 variation in image or picture element value for all 
blocks in the present frame, generates a histogram for 
each value with the frequency represented as the 
number of blocks, and sets the histogram to, for ex- 
ample, a determination threshold T according to the 
46 above described method. Then, the determination 
threshold setting unit 4024 receives from the block in- 
formation storing unit 4022 the variation in image or 
picture element value for each block in the present 
frame, sequentially compares the variation in image 
50 or picture element value for each block with the de- 
termination threshold T, determines a block whose 
variation in image or picture element value is equal to 
or larger than the determination threshold T to be a 
valid block and a block whose variation in image or 
55 picture element value is smaller than the determina- 
tion threshold T to be an invalid block, and rewrites 
the variation in image or picture element value stored 
in the block information storing unit 4022 for each 
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block to a binary block information (T for a valid 
block and B 0" for an invalid block) indicating that each 
block is valid or invalid. 

As described above, if the block information 
about all blocks in the present frame is stored in the 5 
block information storing unit 4022. the encoding 
1060 sequentially reads in a predetermined order 
from the block information storing unit 4022 the block 
information about each block in the present frame, 
and encodes only the data in the blocks whose block 10 
information refers to a valid block in all blocks in the 
present frame. 

Thus, according to the 4th embodiment, a histo- 
gram of the variation in a predetermined image or pic- 
ture element value (for example, the maximum abso- is 
lute value of difference) between corresponding 
blocks in the present frame and the reference frame * 
is generated for one frame, and a determination 
threshold T is set as a reference value for use in ex- 
tracting a valid block in the present frame according 20 
to the generated histogram. Therefore, an appropri- 
ate determination threshold T can be set for each 
frame even if a frame contains a series of mobile im- 
ages having different variations. Thus, the image data 
can be encoded after extracting the optimum valid 25 
block in each frame. 

Based on the frequency (the number of blocks) of 
each value in the variation in a image or picture ele- 
ment value, a determination threshold T can be set 
such that the number of valid blocks can be fixed for 30 
each frame. Therefore, the amount of codes can be 
controlled to be fixed for each frame, and the optimum 
image transmission can be realized under various 
conditions such as the information transmission 
speed of a transmission line, t he number of pieces of 35 
frames per unit time, etc. 

Since the frequency of changes in images is lev- 
eled among frames in moving images, a determina- 
tion threshold T is set only for the first n frames (n=1 , 
2, 3, ...) and a determination threshold T set for the 40 
n-th frame can be used in detecting valid blocks in the 
(n*1)th and the following frames. Thus, an encoding 
process can be performed at a high speed for the 
(n+l)th frame. 

Furthermore, a valid block can be extracted at a 45 
high speed by using the maximum absolute value of 
difference as the variation in a image or picture ele- 
ment value, thereby performing the encoding proc- 
ess at a high speed. The sum of absolute values of dif- 
ferences or the sum of square numbers of differences so 
can be used as the variation in the image or picture 
element value. 

As described above, when moving images are 
encoded, an absolute value of the difference is ob- 
tained for each image or picture element in each block 55 
in the reference frame, the maximum absolute value 
of differences is compared with a predetermined 
threshold, and it is determined whether or not each 



block in the reference frame is valid or invalid. At this 
time, if a image or picture element signal contains any 
noises, then an area that should be normally level in- 
dicates an unleveled color in a block form. 

That is, in a series of blocks in an area where sim- 
ilar colors are used adjacently (for example, a back- 
ground area), if a block is determined to be valid and 
another block adjacent to that block is considered to 
be invalid due to noises, etc. generated in a image or 
picture element signal, then the above described 
problem arises. These block noises appear conspic- 
uously as the encoding process is performed further. 
Accordingly, it is indispensable to periodically refresh 
a reference frame to solve such a problem. 

However, if a refreshing process is performed in 
a conventional method, unnatural flashing Images 
are displayed because large differences are recorded 
between adjacent frames. 

Next, an embodiment for solving such problems 
is explained below. 

Figure 53 is the flowchart indicating the 10th im- 
age data encoding method according to the above 
described embodiment The flowchart indicates a 
process of encoding image data in one frame. 

In this method, image data in the present frame 
are divided into n (n=1, 2, 3, ...) areas (S151). 

According to the present embodiment, determi- 
nation thresholds Th,, Th* Tr* Th„ are individual- 
ly provided for each of the divided areas, and a valid 
block is extracted by using a corresponding determi- 
nation threshold for each block in each area. 

That is, the first area is selected from the above 
described n areas, and the areas are divided to a plur- 
ality of blocks of a predetermined size (for example, 
8x8 image or picture elements or 16x16 image or pic- 
ture elements, etc.) . Then, the variation in a prede- 
termined image or picture element value (the maxi- 
mum absolute value of difference, the sum of abso- 
lute values of differences, or the sum of square num- 
bers, eta) between the corresponding blocks in the 
present and reference frames is obtained, and is com- 
pared with a corresponding determination threshold 
Thd) so that It to determined whether or not the Image 
data are different between the corresponding blocks 
in the present and reference frames (S152 and S1 53). 

Then, a valid block, the is, a block determined to 
have changed in image data compared with the ref- 
erence frame, is extracted ("Yes* in S153), and the 
image data in valid blocks are encoded (S154). On 
the other hand, image data in an invalid block, that is, 
a block determined not to have changed in image data 
compared with the reference frame (S1 53) are not en- 
coded at all. 

When the above described processes in S152 
through S154 have been performed on aD blocks in 
the first area selected first fYes" in S1 55), the proc- 
esses in S152 through S155 are performed on the 
next selected second area 
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Thus, image data are encoded for the valid blocks 
determined as described above in the second area. 

In alt areas in the present frame, if the processes 
in steps S152 through S155 are performed, and the 
encoding process has been performed on all areas in 
the present frame ("Yes" in S156), then the process 
of encoding image data in the present frame is termin- 
ated. 

Thus, a difference generated in an area (differ- 
ence between a reconstructed image and the original 
image) can be reduced by using a determination 
threshold individually for each area in a frame or by 
setting a small determination thresholb for an area. 
That is, if a difference can be detected, the corre- 
sponding block is extracted as a valid block, and an 
encoding process is performed on the valid block. 
Thus, the deterioration of images due to a difference 
in a specific area can be prevented by adjusting a de- 
termination threshold or by reducing the difference in 
a specific area to a level beyond the visual recogni- 
tion. 

Furthermore, the increment in the amount of 
codes detected in a reference frame refreshing proc- 
ess can be minimized. That is, a block is extracted or 
encoded only If it has changed in images to the extent 
that the difference can be recognized (a valid block). 
Therefore, the amount of data to be encoded can be 
reduced and the total amount of codes can be less- 
ened. In this case, a refreshing operation can be per- 
formed without any problem by reducing the determi- 
nation threshold of each area down to a value small 
enough to extract as a valid block only a block whose 
difference in image data generates the deterioration 
in a resultant image. 

Figure 54 is the flowchart indicating the 11th im- 
age data encoding method as another embodiment of 
solving a problem in the above described convention- 
al refreshing process. 

The flowchart in Figure 54 indicates a method of 
encoding a plurality of frames. The process in step 
S 1 62 shown in Figure 54 is equivalent to the process- 
es in steps S151 through S156 in the flowchart 
shown in Figure 53. 

In the encoding method, a determination thresh- 
old individually used in each area in a frame is appro- 
priately modified (S1 61). 

Using a modified determination threshold, the 
image data in the present frame can be encoded ac- 
cording to the flowchart shown in Figure 53 (S162). 

Back in step S1 61, a determination threshold to 
be assigned to each area in the succeeding frame is 
modified, and the image data in the frame are encod- 
ed (S162). 

Likewise, the processes in steps S161 and S162 
are performed on the remaining frames. If the encod- 
ing process has been performed on all frames ("Yes" 
in 163), the encoding process is terminated. 

Thus, a conventional problem that unnatural 



flashing images are generated can be prevented by 
sequentially encoding a series of frames. 

An example of the solution is explained as fol- 
lows. 

For example, a frame is divided to 10 areas, and 
the 10 areas are individually named the 1st area, the 

2nd area and the 10th area. The determination 

thresholds for each of the areas are Th t (for the 1st 
area), Th 2 (for the 2nd area), .... and Th, 0 (forthe 10th 
are.). 

Furthermore, two additional thresholds VAL. and 
VAL5 are provided as determination thresholds. 

VAL.: a threshold for use in a refreshing process 
to determine as an Invalid block a block whose differ- 
ence in images is small enough to generate deterior- 
ation of images that can be recognized. 

VAU: a threshold larger than VAL.. and used to 
reduce the amount of codes. 

When a threshold is modified at frame intervals, 
the threshold to be assigned to each of the areas in 
the 1st to the 10th frames is modified as follows. 

the 1st frame Th, < Thz = Thj = Ttu = The = The 
= Th 7 = Th 8 = Thg = Th io (Th, = VAL., Th 2 = Th 3 = 
Th 10 = VAL b ) 

the 2nd frame Th 2 < Trn = Th 3 = Tru = Th 6 = The 
= Th 7 = The = Th 9 = Th 10 (Th 2 = VAL,, Th, = Th 3 = .... 
Th 10 = VAL b ) 

the 1 0th frame Th 10 < Th t = Th 2 = Th s = Tru = 
Th 5 = The = Thr = Th 8 = Th9 = Th 10 (Th 10 = VAL.. Tn i 
= Th 2 = ..., Th*= VAL*) 

That is, in the 1st frame, threshold VAL. is as- 
signed only to determination threshold Thj in the 1st 
area, while threshold VAL b is assigned to determina- 
tion thresholds Thj through Th 10 . Thus, in the 1st 
frame, the difference in the 1st area in the 1st frame 
is reduced down to the extent that the deterioration 
of image cannot be recognized. 

In the 2nd frame, since threshold VAL. is as- 
signed only to the 2nd area, the difference in the 2nd 
area in the reference frame is reduced down to the ex- 
tent that the deterioration of image cannot be recog- 
nized. 

Likewise, in each frame from the 3rd to the 10th 
frames, the image data in the reference frame are re- 
freshed in the 10th frame by sequentially assigning 
threshold VAL* to the 3rd. the 4th, and the 10th 
area respectively. Then, the image data in the refer- 
ence frame can be refreshed every 10th frame by re- 
peating the above described process on the 11th and 
the following frames. 

If the image data in the reference frame are re- 
freshed by this method, one area is refreshed for 
each frame. Accordingly, unnatural flashing images 
generated in a refreshing process are prevented by 
setting the areas to an appropriate size, thereby solv- 
ing the problem caused by the conventional method. 

Next, another method of solving the problem 
caused by the conventional method is described be- 
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low. 

In this case, ten thresholds having, for example, 
the following correlation are preliminarily provided. 

VAL, < VAL 2 < VAL 3 < VAL, < VAL 5 < VAL« < 
VAL 7 < VALe < VALq < VAL 10 * 
Assume that VAL, corresponds to VAU above. 
The determination threshold assigned to each 
area in the 1st through the 10 frames is modified in 
a loop format as follows. 

the 1 st frame Th, < Th 2 < Th 3 < Th 4 < Th 6 < Th« 10 

< Thr < Tha < < Th, 0 (Th, = VAU (\ = 1 " 1 0) 

the 2nd frame Th 2 < Th 3 < Th 4 < Th 6 < Th e < Thy 

< Trie < Th 9 < Th 10 < Th, (Th, = VAU 1 (i = 2, 3 9 )» 

Th, = VAL 10 ) 



■ 

the 10th frame Th, 0 < Th, < Trt2 < Th 3 < Tru < 
Trig < The < Thy < Th 8 < Th* (Th, 0 = VAL, Thj = VAL^, 
(1 = 1 "9) 20 

In this method, the difference in each area in the 
reference frame can be reduced more gradually than 
the method described above. Therefore, unnatural 
flashing images can be furthermore prevented. 

In the above described two examples, the corre- 25 
spondenae between an area and a determination 
threshold is modified for each frame. However, it can 
be modified optionally for any intervals. Furthermore, 
it can be modified for any time intervals, not frame in- 
tervals. The necessary process is indicated as the 30 
process in step S161 indicated by the flowchart 
shown in Figure 54. 

Figure 55 is the flowchart indicating the 12th im- 
age data encoding method according to another em- 
bodiment for solving the problem caused in the re- 35 
freshing process by the conventional method. 

According to the encoding method indicated by 
the flowchart, the determination threshold used for 
each area in a frame can be modified by an arithmetic 
operation, not by a switch of outputs (S171). This 40 
process is equivalent to the process in step S161 of 
the flowchart shown in Figure 54. A determination 
threshold is modified for each area. 

While a determination threshold for each area is 
modified at predetermined frame intervals or time in- 45 
tervals, the image data in each frame are encoded as 
in the process in step S 162 indicated by the flowchart 
shown in Figure 54 (S171 through S173). 

Therefore, this encoding method provides an ef- 
fect equivalent to that of the 11th image data encod- 50 
ing method indicated by the flowchart shown in Fig- 
ure 54. 

Figure 56 is the block diagram indicating the con- 
figuration of the 24th image data encoding device for 
encoding a series of image data In frame units accord- 55 
ing to the encoding method indicated by the flowchart 
shown in Figures 56, 53, 54, and 55. 

A reference frame storing unit 5030 Is a memory 

42 



for storing image data in the reference frame for use 
in detecting a valid block in the reference frame ap- 
plied through a terminal 5010. 

An area dividing unit 5040 divides image data in 
the present frame applied through the terminal 5010 
into a plurality of areas. Then, it sequentially outputs 
starting with the ist area to a block change determin- 
ing unit 5060, and outputs to a determination thresh- 
old output unit 5050 an identification signal (area 
identification signal) Rid indicating the area being out- 
putted to the block change determining unit 5060. 

In addition to the area identification signal Rid, 
the determination threshold output unit 5050 receives 
a frame signal FR„ indicating the frame number of the 
present frame from a terminal 5020, and outputs to 
the block change determining unit 5060 according to 
these signals the determination threshold for use in 
detecting a valid block in each block in the areas in 
the present frame whose Image data have been input- 
ted to the block change determining unit 5060. 

The block change determining unit 5060 divides 
the image data in each area applied by the area div- 
iding unit 5040 to a plurality of blocks, compares the 
image data in each block with the image data m the 
corresponding block in the reference frame stored in 
the reference frame storing unit 5030, and obtains the 
variation in a predetermined image or picture element 
value. Then, the unit spares the variation in a Image 
or picture element value with the determination 
threshold applied from the determination threshold 
output unit 5050, determines whether the present 
block is valid or invalid, and outputs the determination 
result to the reference frame storing unit 5030, 8 block 
information output unft 5070, and an encoding unit 
5060. 

The block information output unit 5070 receives 
a determination result and externally outputs it 
through a terminal 5090 as block information ("1" for 
a valid block, and "0" for an invalid block). 

On receiving a determination result indicating 
that the present block is valid, the encoding unit 5080 
receives the image data of the block from the area 
dividing unit 5040, and encodes them. It does not en- 
codes the image data of invalid blocks. The unit ex- 
ternally outputs through a terminal 5100 the encoded 
data of valid blocks obtained by the encoding proc- 
ess. 

The reference frame storing unit 5030 receives 
the determination result as a reference frame update 
signal REf (for example, "High" for a valid block, and 
"Low* for an invalid block), and replaces the corre- 
sponding block in the reference frame stored therein 
with the block stored in the area dividing unft 5040 if 
the block is valid. If the block is invalid, the corre- 
sponding block in the reference frame is not replaced 
at all. 

Thus, it is determined whether or not each Mock 
in each divided area of image data in the present 
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frame applied from the terminal 5010 is valid accord- 
ing to an individual determination threshold outputted 
by the determination threshold output unit 5050. 
Then, the encoding unit 5080 encodes only valid 
blocks, and the reference frame storing unit 5020 re- 
places the image data in the corresponding block in 
the reference frame with the image data in the valid 
block. 

Therefore, a series of image data can be appro- 
priately encoded by the image data encoding method 
indicated by the flowchart shown in Figure 54 or 55. 

Next, each of the configuration examples of the 
determination threshold output unit 5050 is shown in 
Figures 57A, 57B, and 57C. 

Figure 57A shows an example of a basic circuit for 
outputting determination threshold Th n (n = 1, 2, ...) 
set for each area in a frame. That is, a threshold stor- 
ing memory 5051 stores determination threshold Th„ 
(n = 1, 2, ...) individual ly corresponding to each area 
in a frame. 

On receiving an area identification signal Rid 
from the area dividing unit 5040 shown in Figure 56, 
an address sending unit 5052 sends an address in the 
threshold storing memory 5051 in which determina- 
tion threshold Th„ corresponding to the area indicat- 
ed by the signal Rid is stored. Thus, the threshold 
storing memory 5051 outputs determination thresh- 
old Th n corresponding to the area being received by 
the encoding area. That is, no frame signals FR,, are 
used in the circuit 

Next, Figure 57 shows a circuit example of 
switching determination threshold Th n for each area 
in each frame. It relates to the image data encoding 
method indicated by the flowchart shown in Figure 
25. In Figure 57, a threshold storing memory 5053 
has a configuration similar to that of the threshold 
storing memory 5051. . 

In Figure 57B, an address transforming unit 5053 
generates an address in the threshold storing mem- 
ory 5052 according to an area identification signal Rid 
received from the area dividing unit 5040 and to a 
frame signal FR„ received through the terminal 5020, 
and outputs the address to the memory 5053 for stor- 
ing determination threshold Th n for the area in the 
present frame outputted from the area dividing unit 
5040 to the block change determining unit 5060. 
Then, the threshold storing memory 5053 outputs de- 
termination threshold Th n for the area in the present 
frame to the block change detecting unit 5060. 

Thus, in this.circuit determination threshold Th n 
is set according to frame signal indicating a frame 
number and to an area identification signal Rid indi- 
cating the area for which a valioVin-valid block deter- 
mination is made. Therefore, determination thredhotd 
Th 0 for each area in a frame can be modified (switch- 
ed) at a predetermined frame intervals (for each of 
any number of frames) as in the image encoding 
method indicated by the flowchart shown in Figure 



55. 

Then, the circuit shown in Figure 57C has the 
function equivalent to that of the circuit shown in Fig- 
ure 57B. with this circuit, a threshold storing memory 
5 5056 shown in Figure 57C has the same configura- 
tion as the threshold storing memory 5053 shown hi 
Figure B. 

On receiving an area identification signal Rid 
from the area dividing unit 5040, an address generat- 

10 ing unit 5057 notifies of an address to be outputted 
the threshold storing memory 5056 storing determi- 
nation threshold Th n for the area in the present frame 
being applied to the block change detecting unit 5020. 
Thus, the threshold storing memory 5056 outputs to 

15 a threshold transforming unit 5058 determination 
threshold Th n for the area stored at the above descri- 
bed address. 

The threshold transforming unit 5058 converts 
determination threshold Th„ to determination thresh- 

20 old Th n ' for the area in the present frame indicated ac- 
cording to a frame signal FRh received from the ter- 
minal 50202, and outputs threshold Th n ' to the block 
change detecting unit 5020. 

Thus, with the circuit, the threshold transforming 

25 unit 5058 converts determination threshold Th n fixed- 
ly assigned to each area in a frame and outputted by 
the threshold storing memory 5056 to determination 
threshold Thn* and outputs it to the block change de- 
tecting unit 5060. Therefore, as in the image data en- 

30 coding method indicated by the flowchart shown in 
Figure 55, modifying predetermined determination 
threshold Th n through an arithmetic operation modi- 
fies the value of determination t hresh old Thn for each 
area in a frame for each of any number of frames. 

35 As described above, according to the present in- 
vention, a frame is divided into a plurality of block 
when a series of images such as moving images, etc 
are encoded, and a block indicating a change in im- 
ages from the preceding frame as indicating a value 

40 larger than a predetermined threshold is extracted as 
a valid block, and only the image data of the valid 
block are encoded. Therefore, moving having rather 
static images between adjacent frames such as TV 
telephone images, moving images , etc . can be com- 

45 pressed efficiently. 

Furthermore, when an original image is recon- 
structed, block information indicating whether a block 
in a frame is valid or invalid is transmitted together 
with encoded data of image data in the valid block. 

so Therefore, an image reconstructing equipment can 
recognize the position of the valid block according to 
the block information. As a result, the image recon- 
structing equipment can display the image in the valid 
block at a correct position when the original image is 

55 reconstructed from the encoded data in the valid 
block. That is, a series of images such as moving im- 
ages, etc. can be reconstructed by modifying images 
in valid blocks. 

43 
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Furthermore, according to the present invention, 
two thresholds are used as determination thresholds 
for use in determining a valid block. The two thresh- 
olds are appropriately used so that image change 
starting and ending portions can be correctly detect- 
ed and the image-changed areas can be extracted as 
a series of valid blocks in adjacent areas where im- 
ages change from those in t he preceding frames even 
if the variation in images is not constant or the areas 
include blocks where images change moderately. 
Thus, a natural image can be reconstructed success- 
fully. 

Additionally, according to the present invention, 
image data are encoded after a frame is divided into 
valid and invalid blocks when a refreshing process is 
performed. Then, the encoded data are divisionally 
transmitted to a reconstructing equipment Thus, a re- 
fresh frame receiving equipment can reconstruct an 
original image without being assigned lengthy wait 
time. Furthermore, the capacity of code buffers for 
storing encoded data can be reduced both in sending 
(encoding) and receiving (reconstructing) equip- 
ments. 

According to the present invention, image data in 
a reference frame (reference images) can be updated 
during a refreshing process at a higher speed than by 
a conventional method. 

Furthermore, according to the present invention, 
a determination threshold used in extracting a valid 
block (whose data are to be encoded) indicating a 
change in images from the reference frame can be 
adaptiveiy set such that the amount of codes refers 
to an appropriate value under various conditions such 
as the transmission rate of images and a transmission 
line, the number of transmitted frames per unit time, 
etc. As a result, an image can be transmitted accord- 
ing to the above described conditions, and a higher 
quality image can be transmitted. 

According to the present invention, the variation 
in a predetermined image or picture element value be- 
tween each block in a transmission frame and the 
corresponding block in the reference frame is ob- 
tained, the frequency (the number of blocks) of the 
variation in a predetermined image or picture element 
value is obtained in all transmission frames, and a de- 
termination threshold is set to extract a valid block 
(whose data are to be encoded) indicating a change 
in images from the reference frame according to the 
frequency. As a result, a determination threshold can 
be set such that the amount of codes refers to an ap- 
propriate value under various conditions such as in- 
formation transmission speed, the number of trans- 
mitted frames per unit time, etc. Thus, the optimum 
image transmission can be realized according to the 
above described conditions. 

Furthermore, according to the present invention, 
a threshold can be assigned individually to each area 
in each frame. Therefore, the value of a threshold is 



minimized for an area in the reference frame to be re- 
freshed and updated so that the deterioration of the 
image in the updated area can be reduced and cannot 
be recognized In the reconstructed image. 

5 Each of the areas in the reference frame can be 

sequentially refreshed at predetermined frame inter- 
vals by changing the above described update areas 
at predetermined frame intervals (for example, 
changing in block line units downwards from the top 

10 of an image). In this case, ail blocks in the reference 
frame are not refreshed simultaneously, but each 
area in the reference frame is sequentially refreshed 
at predetermined frame intervals. As a result, the dif- 
ference in images between adjacent images before 

1 5 and after the refreshed areas, thereby constructing a 
natural image. 

Since ail blocks in the reference frame are not re- 
freshed simultaneously and unconditionally as in the 
conventional method, but only a block indicating the 

20 difference to the extent t hat the deterioration of an im- 
age can be recognized is refreshed, the increment of 
the amount of codes during the refreshing process 
can be minimized. 

While the invention has been shown and desert- 

25 bed with particular reference to the preferred embodi- 
ment t hereof, it will be understood that variations and 
modifications in form and details may be made there- 
in without departing from the spirit and scope of the 
inventions as defined in the appended claims. 

so 

Claims 

1. A method of coding data in units of block by div- 
35 iding a frame into a plurality of blocks comprising: 
steps (S1, S2) of determining the exis- 
tence of change of image data within a block of 
the present frame by comparing an image ele- 
ment within the block of the present frame to the 
40 corresponding Image element of the block in the 
same position in the reference frame; 

based on the result of the determination, 
step (S3) of outputting block information desig- 
nating whether the block in the present frame is 
45 a valid block in which the image changes from the 
reference frame; 

and steps (S4, S5) of coding only the im- 
age data of the valid block. 

50 2. The image data coding method according to 
claim 1 wherein the result of the determination is 
held until the image data of all the valid blocks in 
the present frame is coded and held the block in- 
formation of all the blocks in the present frame is 

55 outputted together with the coded data of the val- 
id blocks in the present frame. 

3. The Image data coding method according to 
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claim 1 wherein the number of the valid blocks 
which are continuous after the valid block is out- 
putted as the block information succeeding the 
coded data of the valid block based on the result 
of the determination. 

4. The image data coding method according to 
claim 1 wherein the block information is coded 
and then outputted. 

5. The image data coding method according to 
claim 1 wherein the image data of the valid blocks 
are coded using an orthogonal transform. 

6. The image data coding method according to 
claim 1 wherein the determining steps (S1 , S2) of 
determining that the image changes from the ref- 
erence frame when the amount of the changes of 
the value of the predetermined image element 
within a block of the present frame compared to 
the corresponding image element of the corre- 
sponding block in the same position in the refer- 
ence frame is more than the predetermined 
threshold value. 

7. The image data coding method according to 
claim 6 wherein the amount of the change of the 
value of the predetermined image element is pro- 
vided by the maximum value of the absolute val- 
ue of the difference between the value of the pre- 
determined image element in the block in the 
present frame and the value in the corresponding 
image element in the corresponding block in the 
reference frame in the same position as in the 
present frame. 

8. The image data coding method according to 
claim 6 wherein the amount of the change in the 
value of the predetermined image element is pro- 
vided by the sum of the absolute value of the dif- 
ference between the value of the predetermined 
image element within a block of the present 
frame and the value of the corresponding image 
element of the corresponding block in the same 
position in the reference frame with regard to all 
the image element in respective blocks in the 
present frame. 

9. The image coding method according to claim 6 
wherein the amount of the change of the prede- 
termined value of the image element is provided 
by the sum of the second power value of the dif- 
ference between the predetermined value of the 
image element within a block of the present 
frame and the value of the corresponding image 
element of the corresponding block in the same 
position in the reference frame. 



1 0. An image data coding apparatus for coding image 
data in units of block by dividing a frame into a 
plurality of blocks comprising: 

a reference frame holding means (612) for 

5 holding the image data of the reference frame; 

a present frame holding means (610) for 
holding the image data of the present frame; 

a determining threshold value holding 
means (61 8a) for holding a t hreshold value to de- 

10 termine whether the image within a block of the 
present frame changes from the corresponding 
image data of the block in the same position in 
the reference frame; 

. change amount calculating means (614) 

15 for obtaining the amount of change of the prede- 
termined value of the image element within a 
block of the present frame compared to the cor- 
responding image of the block in the same posi- 
tion in the reference frame; 

20 block change determining means (616) for 

determining the change of the image between 
the image within a block of the present frame and 
the corresponding image of the block in the same 
position in the reference frame; 

25 selecting means (618) for selecting only 

the image data of the valid block in which the im- 
age changes from the reference frame by said 
block change determining means (616), among 
the imagedata in respective blocks in the present 

30 frame held in the holding means (610); 

coding means (622. 624. 624a, 626, 626a) 
for coding the image data of the valid block input- 
ted from the selecting means (618); 

outputting means (630) for outputting the 

35 result of the determination of the block change 
determining means (616) together with the cod- 
ed data of the valid block generated from the cod- 
ing means (622, 624, 624a, 626, 626a). 

40 11. The image data coding apparatus according to 
claim 10 wherein the coding means (622, 624, 
624a, 626, 626a) encodes the image data of the 
valid block by using an orthogonal transform. 

45 12. The image data coding apparatus according to 
claim 1 0 further comprising: 

block information holding means (620) for 
holding the result of the determination by the 
block change determining means (616) with re- 

50 gard to aO the blocks of the present frame; and 
coded data holding means (628) for hold- 
ing the coded data of ail the valid blocks in the 
present frame which are generated by the coding 
means (622. 624, 624a, 626, 626a); and 

55 wherein said outputting means (630) out- 

puts the result of the determination of all the 
blocks in the present frame held in the block in- 
formation holding means (620) and coded data of 



45 



89 



EP 0 588 653 A2 



90 



all the valid blocks In the present frame held in 
the coded data holding means in a switching 
manner. 

13. The image data coding apparatus according to 
claim 1 0 further comprising: 

calculating means (670) for calculating the 
number of the continuous invalid blocks whose 
images are determined as non-changing from the 
image in the reference frame by using said block 
change determining means (616); and 

wherein the outputting means (630) out- 
puts as the block information the number of con- 
tinuous invalid blocks succeeding the valid block 
calculated by calculating means (670) after the 
coded data of the valid blocks is outputted. 

14. The image data coding apparatus according to 
claim 10 further comprising: 

block information holding means (620) for 
holding the result of the determination by block 
change determining means (616) with regard to 
the blocks of the present frame; 

block information coding means (690) for 
coding the result of the determination of the block 
of the present frame held in the block information 
holding means (620) and for outputting it as block 
information and; 

coded data holding means (628) for hold- 
ing the coded data of the valid blocks of the pres- 
ent frame generated by the coding means (622, 
624, 624a, 626, 626a) and wherein said output- 
ting means (630) outputs the block information 
generated by said block information coding 
means and the coded data of the valid blocks of 
the present frame held in the coded data holding 
means (628) in a switching manner. 

15. The image data coding apparatus according to 
daim 10 wherein 

said amount-of-change calculating means 
(614) obtains the absolute value of the difference 
of the value of the predetermined image element 
within a block of the present frame compared to 
the corresponding image element of the block in 
the same position in the reference frame and pro- 
vides the maximum value of the absolute value of 
the difference in respective blocks of the present 
frame as the amount of the change of the value 
of the predetermined image element 

16. The imaged data apparatus according to claim 1 0 
wherein 

said amount-of-change calculating means 
(614) obtains the absolute values of the differ- 
ence between the values of the predetermined 
image element within a block of the present 
frame compared to the corresponding image ele- 



ment of the block in the same position in the ref- 
erence frame and provides the sum of the abso- 
lute value of the difference in respective blocks of 
the present frame as the amount of changes of 
5 the value of the predetermined image element 

17. The image data coding apparatus according to 
claim 10 

said amount-of-change calculating means 
10 (614) obtains the difference in the image element 
within a block of the present frame compared to 
the corresponding image element of the block in 
the same position in the reference frame and pro- 
vides the sum of the squares of the differences 
15 in the respective blocks in the present frame as 
an amount of the change in the value of the im- 
age element in respective blocks in the present 
frame. 

20 18. A method of decoding image data according to 
claim 1 for decoding the image data comprising: 
the coded data of the image data of the 
valid block and the block information generated 
by said image data coding method comprising: 
25 step (S12) of decoding the image data of 

the valid block from the coded data; 

step (S14, S15) of updating an address of 
an image memory into which the image data of 
the valid block is written, based on the content of 
30 said block information; 

and step (S1 3) of writing the decoded im- 
age data of the valid block intothe image memory 
in accordance with the updated address. 

35 19. An image data decoding method according to 

claim 18, further comprising: 

wherein the step (S15) of updating the 

write address of the image memory for the image 

data of the valid block calculates the number of 
40 the continuous invalid blocks based on the block 

information. 

20. The image data decoding method according to 
claim 18, further comprising: 

45 a step of separating the coded data of the 

valid block and the block information from the re- 
ceived input data. 

21. The image data decoding method according to 
50 claim 18, further comprising: 

a step of decoding the coded block infor- 
mation. 

22. The image data decoding method according to 
55 claim 18 for decoding the coded data of the im- 
age data of the valid block and the coded data of 
the block information generated by said image 
data coding method further comprising: 

48 
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step of decoding the coded data of the 
block information into the original information; 

step (S11, S12) of decoding the valid im- 
age data of the valid block from the coded data 
of the image data of the valid block; 

step (S14, S15) of updating a write ad- 
dress of an image memory for the image data of 
the valid block based on the content of the de- 
coded block information and 

step (S13) of writing the decoded image 
data of the valid block into the image memory in 
accordance with the updated address. 

23. The image data decoding apparatus according to 
claim 10 for decoding the code data and block in- 
formation of the image data of the valid block 
generated by said imaged data coding apparatus 
further comprising: 

an image memory (658) for storing the de- 
coded image data; 

decoding means (646, 648, 650) for de- 
coding the image data of the valid block from the 
decoded data and 

address calculating means (654, 656) for 
calculating the write address of the image mem- 
ory (658) for the image data of the valid block de- 
coded by the decoding means (646, 648, 650) 
from the block information . 

24. The image data decoding apparatus according to 
claim 23 wherein said address calculating means 
(654, 656) calculates the number of continuous 
invalid blocks from the block information and ob- 
tains the write address of the decoded image 
data. 

25. The image data decoding apparatus according to 
claim 23 further comprising: 

separating means (640) for separating the 
coded data and the block information of the im- 
age data from the received input data. 

26. The image data decoding apparatus according to 
claim 13 for decoding the coded data of the im- 
age data of the valid block generated by the im- 
age data coding apparatus further comprising: 

image memory (658) for storing the de- 
code image data; 

decoding means (646, 648, 650) for de- 
coding the image data of the valid block from the 
decoded data; and 

address calculating means (682, 656) for 
calculating the write address of the image mem- 
ory (558) for the image data decoded by the de- 
coding means (648). 

27. The frnage data decoding apparatus according to 
claim 26 wherein said address calculating means 



(652, 656) obtains the write address of the de- 
coded image data based on the number of the 
continuous invalid blocks of the block informa- 
tion. 

5 

28. The image data coding apparatus according to 
claim 26 further comprising: 

separating means (640) for separating the 
coded data and block information of the image 
10 data from the received input data. 

29. The image data decoding apparatus according to 
claim 14 for decoding the image data from the 
coded data of the valid block and the coded data 

is of the block information further comprising: 

image memory (658) for storing the de- 
coded image data; 

decoding means (646) for decoding the 
image data of the valid block from the coded data 
20 of the image data; 

decoding means (696) for decoding the 
coded data of the block information into the block 
information; 

and address calculating means (654, 656) 
25 for calculating the writing address of the image 
data decoded by the decoding means (646). 

30. The image data decoding apparatus according to 
claim 29 wherein said address calculating means 

30 (654, 656) obtains the write address of the de- 
coded image data by calculating the number of 
continuous invalid blocks from the block informa- 
tion. 

35 31. The image data decoding apparatus according to 
claim 29 further comprising: 

a separating means (640) for separating 
the coded data of the image data and the coded 
data of the block information from the input data. 

40 

32. An encoding method of the continuous image 
comprising: 

a step of encoding a refresh frame; and 
a step of dividing said encoding step into 
46 a plurality of sub steps. 

33. A method of encoding comprising: 

a first step (S101) of determining an exis- 
tence of change of the image within a block of the 
so present frame compared to the corresponding 
image of the block in the same position in the ref- 
erence frame; 

a second step (S103) of encoding only the 
valid block of the present frame which is deter- 
mined as having a change from the image of the 
reference frame in the first step (S101) when the 
present frame is not a refresh frame and; 

a third step (S107, S108, S109) of firstly 
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encoding the valid block of the present frame and 
of secondary encoding the invalid block of the 
present frame which is determined as not having 
a change from the reference frame in the first 
step (S101) after the completion of the decoding s 
of the valid block, when the present frame is a re- 
fresh frame. 

34. An image data encoding apparatus for encoding 
continuous image data comprising: 10 

a reference frame holding means (11) for 
holding the image data of the reference frame; 

a present frame holding means (12) for 
holding the image data of the present frame; 

determining threshold value holding 15 
means (13) for holding the threshold value which 
is to be used for determining the existence of the 
change of the image within a block of the present 
frame compared to the corresponding image of 
the block in the same position in the reference 20 
frame; 

block change determining means (14) for 
obtaining an amount of the change of the value 
of the predetermined image within a block of the 
present frame compared to the corresponding 25 
image of the block in the same position in the ref- 
erence frame held in the reference frame holding 
means (11) and for determining the change of the 
image within a block of the present frame com- 
pared to the corresponding image of the block in 30 
the same position in the reference frame; 

block information holding means (15) for 
holding the result of the determination with re- 
gard to respective blocks of the present frame ob- 
tained by the block change determining means 35 
(14) as the block information; 

coding means (1 6) for, based on said block 
information, coding only the valid block of the 
present frame which is determined as having the 
change from the corresponding block in the ref- 40 
erence frame when the present frame is not the 
refresh frame and coding all the blocks of the 
present frame by dividing it into said valid blocks 
and including the invalid blocks which are deter- 
mined not having the change from the image in 45 
the reference frame when the present frame is 
the refresh frame; 

wherein said reference frame holding 
means (11 ) updates the image data within a block 
of the present frame compared to the cor re- so 
spending image of the block in the same position 
in the reference frame. 

35. The image data coding apparatus according to 
claim 34, further comprising: 55 

a refresh signal generating means (19) for 
outputting a refresh signal designating that the 
present frame is the refresh frame, to the encod- 



ing means (16) and the reference frame holding 
means (11) when the number of frames encoded 
by the encoding means (16) reaches the prede- 
termined value. 

36. A method of encoding image continuous data 
comprising: 

a first step (S101) of determining whether 
a block of the present frame changes from the 
corresponding one by comparing the image data 
in respective blocks in t he present frame with the 
corresponding image data in respective block in 
the reference frame at the same position as the 
corresponding one; 

a second step (S 1 03) of encoding only the 
valid block of the present frame which is deter- 
mined as having the change in the image from 
that of the reference frame according to the first 
step (S101) when the present frame is not a re- 
fresh frame; 

a third step (S103, S107, S108. S109, 
S11 0) of encoding the invalid blocks which is de- 
termined as not having the change from the ref- 
erence frame in accordance with the first step 
(S101) after the completion of encoding of the 
valid block when the present frame is the refresh 
frame; 

a fourth step (S107, S 121) of updating the 
block in the reference frame which corresponds 
to the encoded valid block of the encoded pres- 
ent frame, to the encoded valid block in the en- 
coded present frame after the completion of the 
second step (S103); and 

step (S122) of switching image data of the 
present frame into the image data of the refer- 
ence frame after the completion of the third step 
(S103, $107, $108, S109, S110). 

37. The image data encoding apparatus for encoding 
continuous image data comprising: 

a reference frame holding means (21) for 
holding image data of the reference frame; 

the present frame holding means (22) for 
holding the image data of the present frame; 

determining threshold value holding 
means (23) for holding a threshold value to be 
used for determining the existence of the change 
of the image within a block of the present frame 
compared to the corresponding image of the 
block in the same position in the reference frame; 

block determining means (24) for obtain- 
ing an amount of the changes of the value of the 
predetermined image element in respective 
blocks in the present frame held in the present 
frame holding means (22) from the correspond- 
ing one held in the reference frame holding 
means (21) at the same position as the corre- 
sponding one in the present frame and determi- 
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nes whether image in respective blocks in the 
present frame changes from that in the reference 
frame by comparing said amount of changes with 
a threshold value held in the determination 
threshold value holding means (23); . 5 

block information holding means (25) for 
holding the result of the determination of all the 
blocks of the present frame designated by the 
block change determining means (24) as block 
information; io 

encoding means (26) for, based on the 
block information of respective blocks of the 
present frame held in the block information hold- 
ing means (25), encoding only the valid block of 
the present frame which is determined as having 1 s 
the change from the corresponding one in the 
reference frame when the present frame is not a 
refresh frame and for coding all the blocks of the 
present frame when the present frame is the re* 
fresh frame; 20 

a frame changing means (27) for changing 
the reference frame holding means (21) to the 
present frame holding means (22) and for chang- 
ing the present frame holding means (22) to the 
reference frame holding frame means (2 1 ) where 25 
the present frame coded by the holding means 
(26) is a refresh frame and 

wherein said reference frame holding 
means (21) updates the image data of the block 
in the reference frame at the same position as the 30 
encoded valid block of the present frame to the 
image data of the valid frame block in the encod- 
ed present frame when the encoded present 
frame is not a refresh frame! 

35 

38. A met hod of encoding the image data comprising: 
a first step (S131) of determining one of 
changes of the value of the predetermined image 
element in respective blocks of the present frame 
from the corresponding one in the reference 40 
frame in the same position as that of the present 
frame; 

comparing (S131) the amount of changes 
with the predetermined threshold value and 

determining (S131) the existence of the 45 
change of the image in respective blocks in the 
present frame from the corresponding one of the 
reference frame in the same position as that of 
the present frame; 

a second step (S131) of coding only the 50 
vafid block of the present frame which is deter- 
mined as having the change from the corre- 
sponding one of the reference frame in accor- 
dance with the first step (S131); and 

a third step (S1 38) of changing the thresh- 55 
old value used in the comparing step ($131) in 
accordance with the change of the image be- 
tween the reference frame and the present frame 



based on the result in the comparing step (S131). 

39. A method of encoding the image data comprising: 

a first step (S131) of determining an 
amount of changes of the predetermined value of 
the image element in respective blocks of the 
present frame from the corresponding one in the 
block in the reference frame at the same position, 
comparing the amount of changes with deter- 
mined threshold value and determining the exis- 
tence of the variation of the images In respective 
blocks in the present frame from corresponding 
one in the reference frame at the same position; 

a second step (S132) of encoding only a 
valid block of the present frame which is deter- 
mined as having the change in the image from 
the reference frame in accordance with the first 
step(S131); 

a third step (S132-S135) of determining 
whether the threshold value used in the first step 
(S131) is appropriate, based on a coding amount 
obtained by the second step (S132) and chang- 
ing the threshold value to another value when the 
value is determined as being an inappropriate 
value and 

wherein said first and second steps (S1 31 , 
S132) and the third step (S137) determine that 
the threshold value is appropriate. 

40. A method of encoding the image data according 
to the claim 39 wherein 

said third step (S132-S135) is applied to a 
first frame or any frame and 

the first step (S101) uses the threshold 
values determined by any preceding frame in the 
third means $1 32-S1 35) which is performed pre- 
cedingly. 

41. An apparatus for encoding continuous image 
data comprising: 

a first means (1 030, 3020, 3026, 3028) for 
obtaining an amount of changes of the predeter- 
mined value of the image element and respective 
blocks of the present frame from the correspond- 
ing one in the reference frame in the same posi- 
tion as that in the present frame, comparing the 
amount of the changes with a predetermined 
threshold value, and for determining the exis- 
tence of changes of the image in respective 
blocks in the present frame; and 

a second means (3022) for determining 
whether the threshold value in the first means 
(3020) is appropriate or not based on the number 
of the valid blocks of the present frame which is 
determined as having a change in the image from 
that in the reference frame in accordance with 
the first means (1030) or the number of invalid 
blocks of the present frame which is determined 
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as not having change in the image from the ref- 
erence frame and changing the said threshold 
value to other value when the threshold value is 
not appropriate; 

a third means (3029) for encoding the s 
block in the present frame which is determined as 
being the valid block in accordance with a first 
means (1033) when the threshold value is deter- 
mined as an appropriate value in accordance with 
the second means (3022) and 10 

wherein the first means (1033) is per- 
formed when the new threshold value is deter- 
mined in accordance with the second means 
(3022). 

15 

42. A method of decoding the image data according 
to claim 41 wherein: 

said second means (3022) is applied to 
only a first frame or any frame and the threshold 
value determined for the preceding frame in the 20 
second means (3022) in the preceding stage is 
used in the first means (1030) when the succeed- 
ing frame is encoded. 

43. An image data encoding apparatus for encoding 2s 
continuous image data comprising: 

reference frame holding means (31) for 
holding an image data of a reference frame; 

present frame holding means (32) for hold- 
ing an image data of the present frame; 30 

determining threshold value holding 
means (33) for holding a threshold value to be 
used for determining the existence of change in 
the image within its respective block of the pres- 
ent frame from the corresponding image in the 35 
block in the reference frame in the same position 
as that of the present frame; 

block change determining means (34) for 
obtaining the amount of a change of the value of 
the predetermined image element in the respec- 40 
trve block in the present frame held in the present 
frame holding means (32) at the same postion as 
the corresponding image held in the reference 
frame holding means (31); 

encoding means (35) for encoding only a 45 
valid block which is determined as having a 
change in the image in the block in the present 
frame from the corresponding one in the refer- 
ence frame by said block change determining 
means (34); so 

determining threshold value changing 
means (36) for determining whether the thresh- 
old value held in the determining threshold value 
holding means (33) is appropriate, based on the 
amount of coded data produced by the encoding 55 
means (35), and for setting the value different 
from the said threshold value in the determining 
threshold value holding means (33) when the 



threshold value is not appropriate; and 

encoding data outputting means (37) for 
outputting the coded data encoded by the encod- 
ing means (35), when the threshold value held in 
the determining threshold value holding means 
(33) is determined as appropriate by the deter- 
mining threshold value changing means (36). 

44. An image data coding apparatus for coding con- 
tinuous image data comprising: 

reference frame holding means (41) for 
holding the image data of the reference frame; 

present frame holding means (42) for hold- 
ing the image data of the present frame; 

determining threshold value holding 
means (43) for holding the threshold value to be 
used to determine the existence of change in the 
image in the respective block in the present 
frame from the corresponding image in the block 
at the same position in the reference frame; 

block change determining means (44) for 
obtaining the amount of change in the value of 
the predetermined image element in the respec- 
tive block of t he image data of the present frame 
held in the present frame holding means (42) 
from the corresponding image element in the ref- 
erence frame held in the reference frame holding 
means (41) at the same position as the corre- 
sponding one in the present frame and determin- 
ing the existence of a change in the Image in re- 
spective block of the present frame from the cor- 
responding image in the block at the same posi- 
tion as the corresponding one in the present 
frame by comparing the amount of the change 
with the threshold value held in the determining 
threshold value holding means (43); 

determining threshold value changing 
means (45) for calculating the number of valid 
blocks of the present frame which are determined 
as having the change in the image from the ref- 
erence frame, or the number of invalid blocks in 
the present frame which is determined as not 
having changed from the image in the reference 
frame, by means of the block change determining 
means (44), for determining whether the thresh- 
old value held in the determining threshold value 
holding means (43) is appropriate, based on the 
number of valid blocks or invalid blocks and for 
setting a value difference for the threshold value 
in the determining threshold value holding 
means (43) when the threshold value is not ap- 
propriate, and; 

encoding means (46) for encoding only the 
block of the present frame held in the present 
frame holding means (42), which is determined 
as the valid block by the block change determin- 
ing means (44) when the threshold value held in 
the determining threshold value holding means 
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(43) is determined to be appropriate by t he deter- 
mining threshold value changing means (45). 

45. A method of encoding the continuous image data 
comprising: 5 

a first step ($141, S142) of obtaining the 
amount of the change in the value of the prede- 
termined image element which forms a reference 
value to be used to determine the existence of 
change in the image in the respective block of the 10 
present frame at the same position compared to 
the corresponding image element in the block in 
the reference frame at the same position, based 
on the image data of the present frame and the 
image data of the reference frame and preparing 1 s 
a histogram of the present frame as a whole, with 
regard to the amount of the changes in the values 
of the predetermined image element; 

a second step (S143) of providing a deter- 
mining t hres hold value to be used for determining 20 
the existence of change in the image element in 
the respective block in the present frame from the 
corresponding image element in the reference 
frame at the same position as the corresponding 
one in the present frame, based on the histogram 25 
obtained through the first step (S141, S142); 

a third step (S144) of obtaining the amount 
of change in the value of the predetermined im- 
age element in the respective block of the pres- 
ent frame from that in the reference frame at the so 
same position as the corresponding one in the 
present frame and detecting the existence of the 
variation of the image from the reference frame, 
with regard to the blocks of the present frame; 
and 35 

a fourth step (S145) of encoding only the 
image data of the valid block which is determined 
as having changed in the image in the respective 
blocks of the present frame from the correspond- 
ing image in the reference frame in accordance 40 
with the third step. 

46. An image data encoding apparatus for encoding 
continuous image data comprising: 

reference frame holding means (51) for 45 
holding the image data of the reference frame; 

present frame holding means (52) for hold- 
ing the image data of the present frame; 

a histogram preparing means (53) for ob- 
taining the amount of change in the value of the so 
predetermined image element which forms the 
reference values to be used, to detect the exis- 
tence of change in the image in the respective 
block in the present frame from the correspond- 
ing image element in the block in the reference 55 
frame at the same position, based on the image 
data of the reference frame held in the reference 
frame holding means (51) and the image data of 



the present frame held in the present frame hold- 
ing means (52) and preparing histogram of the 
present frame as a whole, with regard to the 
amount of the change of the present frame; 

determining threshold value setting 
means (54) for determining the threshold value to 
be used to determine the existence of change in 
the image in the respective blocks of the present 
frame from the corresponding one in the refer- 
ence frame at the same position, based on the 
histogram prepared by the histogram preparing 
means (53); 

block change determining means (55) for 
comparing the amount of change in the value of 
the predetermined image element in the respec- 
tive blocks of the present frame, obtained by the 
histogram preparing means (53) with the deter- 
mining threshold value provided by the determin- 
ing threshold value providing means (54) and for 
determining the existence of change in the image 
of the respective blocks in the present frame from 
the blocks in the reference frame at the same 
position as the corresponding image of the pres- 
ent frame; and 

encoding means (56) for encoding only the 
valid blocks which are determined as having 
changed the image by the block change deter- 
mining means (55), and which are selected from 
al! the blocks of the present frame. 

47. The image data encoding apparatus according to 
claim 46, wherein said histogram preparing 
means (53) obtains the absolute value of the dif- 
ference between the value of the predetermined 
image element in respective blocks In the present 
frame and that of the image element in the blocks 
in the reference frame at the same position as the 
corresponding one in the present frame, provides 
the maximum value of the absolute value of the 
difference in respective blocks of the present 
frame as the amount of change in the value of the 
predetermined image element and prepares a 
histogram with regard to the amount of change. 

48. A method of encoding the continuous image data 
comprising: 

a first step (S151) of dividing the image 
data of the present frame into a plurality of re- 
gions and; 

a second step (S152, S153) of obtaining 
the amount of change in the value of the prede- 
termined image element in the respective blocks 
of the respective regions of the present frame ob- 
tained by the first step (S151) from the image ele- 
ment in the reference frame at the same position 
as the corresponding one in the present frame 
and determining the existence of change of the 
image in the respective blocks of the present 
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frame from that of the reference frame. 

49. A method of encoding continuous image data 
comprising: 

a first step (S151) of dividing the image 
data of the present frame into a plurality of re- 
gions; 

a second step (S152, S153) of obtaining 
the amount of change in the value of the prede- 
termined image element in respective blocks of 
the each of respective regions of the present 
frame obtained by the first step (S151) from the 
corresponding image in the block in the refer- 
ence frame at the same position, comparing the 
amount of change with the threshold value cor- 
responding to respective regions which is select- 
ed from a plurality of threshold values and detect- 
ing the existence of change in the image in the 
respective blocks of the present frame from that 
in t he reference frame at the same position as the 
corresponding image in the present frame; 

a third step ($154) of encoding only the 
valid block of the present frame which is deter- 
mined as being changed from that of the refer- 
ence frame in accordance with second step 
(S152,S153);and 

a fourth step of replacing the block in the 
reference frame at the same position as the valid 
block encoded through the third step (S154) by 
the valid block. 

50. A method of encoding image data according to 
daim 49, wherein said second step (S152, S153) 
comprises a step (161) of changing the relation 
between the plurality of regions of the present 
frame and the plurality of threshold values as- 
signed to the respective regions at a predeter- 
mined frame interval. 

51. A method for encoding image data according to 
daim 49, wherein the threshold value assigned to 
the respective regions of the present frame in the 
second step (S152, S153) is changed in a prede- 
termined frame interval. 

52. The image data encoding apparatus for encoding 
the continuous image data comprising: 

a reference frame holding means (61) for 
holding the image data of the reference frame; 

a dividing means (62) for dividing the im- 
age data of the present frame into a plurality of re- 
gions; 

a determining threshold value outputting 
means (63) for outputting the threshold value to 
be used to detect the existence of change in the 
image in the respective block in the respective re- . 
gions in the present frame from the correspond- 
ing image in the respective block in the respec- 



tive region in the reference frame/ each respec- 
tive regions comprising a plurality of blocks and 
being provided by the dividing means (62); 

the block change determining means (64) 

5 for obtaining the amount of change in the value 
of the predetermined element In the block of the 
present frame from the corresponding image ele- 
ment in the block in the reference frame held in 
the reference frame holding means (61), with re- 

10 gard to the respective blocks in the respective re- 
gions of the present frame which are obtained in 
accordance with the output of the dividing means 
(62), comparing the amount of change with the 
threshold value inputted from the determining 

15 threshold value outputting means (63) and for de- 
termining the existence of change in the image in 
the respective blocks regarding the respective 
regions of the present frame from the corre- 
sponding image in the block in the reference 

20 frame at the same position; 

encoding means (65) for encoding only t he 
valid block which is determined as having 
changed the image in the reference frame by 
means of block change determining means (64); 

25 block information outputting means (66) 

for outputting the result of the determination as 
the block information, by the block change deter- 
mining means (64) wherein; 

the reference frame holding means (61) 

30 replaces the block in the reference frame at the 
same position as the valid block in the reference 
frame by the valid block of the present frame, 
based on the result of the determination by the 
block change determining means (64). 

35 

53. The image data encoding apparatus according to 
claim 52, wherein said determining threshold val- 
ue outputting means (63) comprises the thresh- 
old value holding means (63b) for holding a plur- 
ality of threshold values and controlling means 
(63a) for switching the threshold value outputted 
to the block change determining means (64) from 
the threshold value holding means (63a) in accor- 
dance with respective regions of the present 
frame with a predetermined frame. 

54. The image data encoding device according to 
claim 52, wherein said determining threshold val- 
ue outputting means (63) comprises a threshold 
value holing means (63d) for holding a plurality of 
threshold values corresponding to a plurality of 
regions of the present frame; and control means 
(63e) for outputting the threshold value corre- 
sponding to the respective regions of the present 
frame from said threshold value holding means 
(63b) and threshold value changing means (630 
for obtaining the threshold value outputted from 
said threshold value changing means (63d) in ac- 
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cordance with the respective regions of the pres- 
ent frame to output the changed threshold value 
to the block change determining means (64). 

55. A method of encoding image data in unit of block 
by dividing a frame into a plurality of Mocks com- 
prising: 

steps (S21, S31 , S36, S42. S52, S54, S59, 
S72, s76, S79, S80) of obtaining the amount of 
change of the value of the predetermined image 
element In the respective blocks of the present 
frame from that of the block in the reference 
frame at the same position as that of the present 
frame, comparing the amount of change in the re- 
spective blocks in the present frame with the de- 
termining threshold value and determining 
whetherthe respective block in the present frame 
is a valid block in which the image changes from 
. that in the reference frame; 

steps (S23, S25, S33, S35, S53, S73, S75. 
S77, S78) of changing the determining threshold 
value in accordance with the result of determina- 
tion; and 

steps (S24, S38, S40, S43, S56, S60) of 
decoding the image data in the block which is de- 
termined as the valid block in accordance with 
the above determining steps. 

56. The method of encoding the image data accord- 
ing to Claim 55 further comprises: 

steps (S25, S33, S53) of changing the de- 
termining threshold value in accordance with the 
result of determination by the present block; and 

determining steps (S21, S36, S54) of de- 
termining whether the adjacent Mock of the pres- 
ent block in the present frame is a valid block, us- 
ing the changed determining threshold value. 

57. The method of encoding of the image data ac- 
cording to Claim 56 wherein; 

the step (S23) of changing the determin- 
ing threshold value decreases the determining 
threshold value when the present block is deter- 
mined as being a valid block and the determining 
step (S21) determines the block following the 
present block as a valid block, based on the de- 
creased determining threshold value. 

58. The method of encoding the image data accord- 
ing to Claim 56 wherein; 

the step (S33) of changing the determin- 
ing threshold value decreases the determining 
threshold value when the present block is deter- 
mined as being a valid block, and the determining 
step (S36) determhes again whether the block 
preceding the present block is a valid block, 
based on the decreased determining threshold 
value. 



59. A method of encoding image data according to 
Claim 58, wherein; 

the step (S33) of changing the determin- 
ing threshold value returns the determining 
5 threshold value to an original value, when the 
present block is determined as being an invalid 
block. 

60. The method of encoding the image data accord- 
to ing to Claim 56, wherein; 

the result of the determination of the pres- 
ent block in the determining steps (S52, S72, 
S76), and the result of the determination steps 
(S54, S79, S80) of the consecutive block based 
is on the determining threshold value changed by 
the determining threshold value changing steps 
(S53, S78) determine whether the present block 
is a valid block. 

61. The method of encoding the image data accord- 
ing to Claim 60, wherein; 

the determining threshold value changing 
step (S53) increases the determining threshold 
value when the determining step (S52) determi- 
nes that the present block is the valid block, and 
the determining step (S54) determines whether 
the block following the present block is a valid 
block based on the changed determining thresh- 
old value and the present block is determined as 
being the valid block, when the result of the de- 
termination shows a valid block. 

62. The method of encoding the image data accord- 
ing to Claim 60, wherein: 



35 when the present block is determined as 

being the invalid block in the determining step 
(S72), the determining threshold value changing 
step (S75) decreases the threshold value the de- 
termining step (S76) determines again the pres- 

40 ent block by using the changed determining 
threshold value, the determining threshold value 
is again increased when the present block is de- 
termined (S73) as being the invalid block by the 
next determination, it is determined (S79, S80) 

45 whether the adjacent block is as the valid block 
based on the increased determining threshold 
value and the present block is determined as the 
valid block, if the block preceding of the present 
block or the block succeeding the present block 

so is the valid block, said preceding and succeeding 
block being included in the adjacent block. 

63. An image data encoding apparatus encoding the 
continuous image data comprising; 
55 a reference frame holding means (702) for 

holding the image data reference frame; 

a present frame holding means (700) for 
holding the image data of the present frame; 
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determining threshold value holding 
means (706) for holding the threshold value 
which is used to determine the existence of 
change in the image of the block in the present 
frame compared to the corresponding image of 5 
the block at the same position in the reference 
frame and 

block change determining means (704) for 
. obtaining the amount of the change in the value 
of the predetermining image element with regard 10 
to the image data in the present frame held in the 
present frame holding means (700) compared to 
the corresponding image data in the block in the 
same position in the reference frame held in the 
reference frame holding means (702), comparing is 
the amount of change within the threshold value 
held in the determining threshold value holding 
means (706), determining a valid block in which 
the image changes in the block of the present 
frame compared to the corresponding image in 20 
the block in the same position in the reference 
frame, and changing determining threshold value 
output from the determining threshold value 
holding means (706) in accordance with the re- 
sult of the determination; 25 

coding means (710) for coding the image 
data of the block which is determined as the valid 
block by the block change determining means 
(704). 

30 

64 The image data coding apparatus according to 
claim 63, wherein; 

the block change determining means 
(704) decreases the determining threshold value 
output from the determining threshold holding 35 
means (706) when the present block is deter- 
mined as being a valid block, thereby using the 
determined threshold value determining whether 
the blocks is invalid. 

40 

65. The image data coding apparatus according to 
claim 63, further comprising; 

block information holding means (706), 
which holds the result of the determination of all 
the blocks of the present frame obtained by block 45 
change determining means (704) as block infor- 
mation. 

66. The image data coding apparatus for coding con- 
tinuous image data comprising; 50 

reference frame holding means (700) for 
holding the image data of the reference frame; 

present block holding means (700) for 
holding the image data of the present block; 

preceding block holding means (724) for 55 
holding the image data of the preceding block in 
the present frame; 

determining threshold value holding 



means (706) for holding the threshold value to be 
used for determining the existence of change in 
the image in the block in the present frame com- 
pared to the corresponding image in the block in 
the same position in the reference frame; 

block change determining means (722) for 
determining the amount of change in the value of 
the predetermined image element in the block in 
the present frame compared to the correspond- 
ing image in the same position in the reference 
frame wit h regard to t he prese nt block in the pres- 
ent frame in the present block holding means 
(700), and; 

determining that the preceding block of 
the present frame in the preceding block holding 
means (724) determines the valid block for the 
image in the block of the present frame compared 
to the corresponding image in the same position 
in the reference frame by comparing the amount 
of change with the threshold value held in the de- 
termining threshold value holding image (706) 
and; 

changing the value of the threshold output 
from the determining threshold value holding 
means (706), in accordance with the result of the 
determination; and 

coding means (710) for coding the image 
data of the block which is determined as being 
the valid block by the block change determining 
means (722, 742, 736); 

wherein the block change determining 
means (732) decreases the determining thresh- 
old value outputted from the determining thresh- 
old value holding means (706) when the present 
block is determined as the valid block and deter- 
mines whether or not the reference block held in 
preceding block holding means (724) is the valid 
block by using the changed threshold value; and 

coding image data of the preceding block 
held in the block holding means (724) by using 
the holding means (710). 

67. The image data coding apparatus for coding con- 
tinuous image data comprising; 

the reference frame coding means (702) 
for holding the image data of the reference frame; 

the present block holding means (732) for 
holding the image data of the present block in 
present frame; 

the reference block holding means (724) 
for holding the image data of the reference block 
of the present frame; 

a determining threshold value holding 
means (706) for holding the threshold value for 
the determination of the existence of the change 
in the image in the block of the present frame 
compared to the corresponding image in the 
block in the same position in the reference frame; 
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a block change determining means (736) 
for obtaining the amount of change in the value 
of the predetermined image element in the pres- 
ent block in the reference frame held in the pres- 
ent block holding means (732) or in the reference 5 
block held in the reference Nock means (734) 
compared to the corresponding image element in 
the Mock at the same position in the reference 
frame; 

comparing the amount of the change to 10 
the threshold value held in the determining 
threshold value holding means (706), in order to 
determine the valid blocks in which the image 
changes in the block of the present frame com- 
pared to the image in the block in the same pos- is 
itton in the reference frame; and 

changing the value of the determining 
threshold value outputted from the determining 
threshold value holding means (706) in accor- 
dance with the result of the determination; 20 

holding means (710) for holding the image 
data of the block determined as a valid block by 
the block change determining means (736); 

wherein the determining threshold value 
outputted from the determining threshold value 25 
holding means (706) is increased when the block 
change determining means (706) determines 
that the present block is a valid block and deter- 
mines whether the subsequent block Is the valid 
block based on the changed determining thresh- 30 
old value and the coding means (710) encodes 
the image data of the present block held in the 
present block holding means (732) when the sub- 
sequent block is the valid block. 

35 

68. An image data coding apparatus for coding a con- 
tinuous image data comprising; 

reference frame holding means (701) for 
holding the image data of the reference frame; 

preceding block holding means (724) for 40 
holding the image data in the preceding block of 
the present frame; 

present block holding means (732) for 
holding the image data in the present block of the 
present frame; 4$ 

subsequent block holding means (734) for 
holding the image data of the subsequent block 
in the present frame; 

threshold value holding means (706) for 
holding a threshold value to be used to determine 50 
the existence of the change in the image in the 
present block of the present frame compared to 
the corresponding image in the block in the same 
position in the reference frame; 

block change determining means (742) for 56 
obtaining the amount of change in the predeter- 
mined value of the image in the present block in 
the present frame held in the present block hold- 



ing means (732), the preceding block held in the 
preceding block holding means (724) or the sub- 
sequent block held in the subsequent block hold- 
ing means (734), compared to the corresponding 
image in the block at the same position in the ref- 
erence frame in the reference frame holding 
means (701), 

comparing the amount of the change with 
the threshold value held in the determining hold- 
ing means (706), determining the existence of 
the valid block which the image in t he block in the 
present frame changes compared to the corre- 
sponding image in the same position of the refer- 
ence frame; and 

changing the value of the threshold value 
outputted from the determining threshold value 
holding means (706) in accordance with the re- 
sult of the determination; and 

coding means (710) for coding the image 
data of the block which is determined as the valid 
block by the block change determining means 
(742) and 

wherein said determining threshold value 
is outputted from the determining threshold value 
holding means (706) and is decreased when the 
block change determining means (740) determi- 
nes that the present block is an invalid block and 

the coding means (710) encodes the im- 
age data of the present block when the preceding 
block is determined as being the valid block 
based on the changed determining threshold val- 
ue or the subsequent block is determined as the 
valid block even if the preceding block is deter- 
mined as the invalid block as a result of the above 
determination. 
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